www.acad.jobs : academic jobs worldwide – and the best jobs in industry
                
     
Position: Senior Data Engineer
Institution: Verisk Analytics, Inc.
Location: Edinburgh, United Kingdom
Duties: Gathering data requirements, such as how long the data needs to be stored, how it will be used and what people and systems need access to the data; Maintaining metadata about the data, such as what technology manages the data, the schema, the size, how the data is secured, the source of the data and the ultimate owner of the data; Ensuring security and governance for the data, using centralized security controls, encrypting the data, and auditing access to the data; Storing the data, using specialized technologies that are optimized for the particular use of the data, such as a relational database, a NoSQL database, Hadoop, or Amazon S3
Requirements: Excellent programming skills, particularly in one or more of SQL, R, Python; Experience with SQL and NoSQL (e.g., SQLServer, Postgres, Aurora, Hadoop, HBase and/or Neo4j) databases; Extensive experience with modern ETL tools (e.g. EMR, AWS Glue, AWS Step Functions, Kafka etc.); Experience contributing along side Principle Engineers, to the Architectural conceptualization, design, implementation, and maintenance of modern data pipelines; Effective communication (written and oral) skills; Hands on expertise with agile methodologies and comprehensive understanding of modern patterns and practices (e.g. XP, Scrum)
   
Text: Wood Mackenzie Senior Data Engineer Edinburgh, UK Employees can work remotely Full-time Verisk Business: Wood Mackenzie Company Description Wood Mackenzie is the global leader in data, analysis and consulting across the energy, chemicals, metals, mining, power and renewables sectors. Founded in 1973, our success has always been underpinned by the simple principle of providing trusted research and advice that makes a difference to our customers. Today we have over 2,000 customers ranging from the largest global energy companies and financial institutions to governments as well as smaller market specialists. Our teams are located around the world. This enables us to stay closely connected with customers and the markets and sectors we cover. Collectively this allows us to offer a compelling combination of global commodity analysis with detailed local market knowledge. We are committed to supporting our people to grow and thrive. We value different perspectives and aspire to create an inclusive environment that encourages diversity and fosters a sense of belonging. We are committed to creating a workplace that works for you and encourage everyone to get involved in our Wellness, Diversity and Inclusion, and Community Engagement initiatives. We actively support flexible working and are happy to consider alternative work patterns, taking into account your needs and the needs of the team or division that you are looking to join. Hear what our team has to say about working with us: https://www.woodmac.com/careers/our-people/ We are proud to be a part of the Verisk family of companies! At the heart of what we do is help clients manage risk. Verisk (Nasdaq: VRSK) provides data and insights to our customers in insurance, energy and the financial services markets so they can make faster and more informed decisions. Our global team uses AI, machine learning, automation, and other emerging technologies to collect and analyze billions of records. We provide advanced decision-support to prevent credit, lending, and cyber risks. In addition, we monitor and advise companies on complex global matters such as climate change, catastrophes, and geopolitical issues. But why we do our work is what sets us apart. It stems from a commitment to making the world better, safer and stronger. It’s the reason Verisk is part of the UN Global Compact sustainability initiative. It’s why we made a commitment to balancing 100 percent of our carbon emissions. It’s the aim of our “returnship” program for experienced professionals rejoining the workforce after time away. And, it’s what drives our annual Innovation Day, where we identify our next first-to-market innovations to solve our customers’ problems. At its core, Verisk uses data to minimize risk and maximize value. But far bigger, is why we do what we do. At Verisk you can build an exciting career with meaningful work; create positive and lasting impact on business; and find the support, coaching, and training you need to advance your career. We have received the Great Place to Work® Certification for the fifth consecutive year. We’ve been recognized by Forbes as a World’s Best Employer and a Best Employer for Women, testaments to our culture of engagement and the value we place on an inclusive and diverse workforce. Verisk’s Statement on Racial Equity and Diversity supports our commitment to these values and affecting positive and lasting change in the communities where we live and work. Job Description Wood Mackenzie is looking for a future focused Senior Data Engineer with excellent problem solving, teamwork, and communication skills to join our industry-leading data analytics company. We are headquartered in Edinburgh where our team is working on a next generation, data analysis & visualization platform utilized by our customer to drive billion-dollar decisions. This role will be responsible for the implementation of high-quality data pipelines that enables high quality data from various sources to flow through our organization. If you are looking to work for a company that matters, a company which has a significant and growing impact in the world, and if having a sense of purpose and contribution is important to you, we want to hear from you. What you'll do… Gathering data requirements, such as how long the data needs to be stored, how it will be used and what people and systems need access to the data. Maintaining metadata about the data, such as what technology manages the data, the schema, the size, how the data is secured, the source of the data and the ultimate owner of the data. Ensuring security and governance for the data, using centralized security controls, encrypting the data, and auditing access to the data. Storing the data, using specialized technologies that are optimized for the particular use of the data, such as a relational database, a NoSQL database, Hadoop, or Amazon S3. Processing data for specific needs, using tools that access data from different sources, transform and enrich the data, summarize the data and store the data in the storage system. To address these responsibilities, you will be required to perform different tasks. Some examples include: Acquisition: Sourcing the data from different systems Cleansing: Detecting and correcting errors Conversion: Converting data from one format to another Disambiguation: Interpreting data that has multiple meanings De-duplication: Removing duplicate copies of data #LI-RA1 Qualifications Excellent programming skills, particularly in one or more of SQL, R, Python, Experience with SQL and NoSQL (e.g., SQLServer, Postgres, Aurora, Hadoop, HBase and/or Neo4j) databases Extensive experience with modern ETL tools (e.g. EMR, AWS Glue, AWS Step Functions, Kafka etc.) Experience contributing along side Principle Engineers, to the Architectural conceptualization, design, implementation, and maintenance of modern data pipelines. Effective communication (written and oral) skills Hands on expertise with agile methodologies and comprehensive understanding of modern patterns and practices (e.g. XP, Scrum) Experience coaching, and mentoring individuals and teams. Solid knowledge of modern cloud architectures (e.g., microservices, serverless, event driven architectures) and technologies specifically AWS. Proven knowledge of continuous delivery and approaches to continuous integration (Jenkins, Docker, Cloudformation/Terraform) Degree in a relevant subject area Additional Information Verisk Analytics is an equal opportunity employer. All members of the Verisk Analytics family of companies are equal opportunity employers. We consider all qualified applicants for employment without regard to race, religion, color, national origin, citizenship, sex, gender identity and/or expression, sexual orientation, veteran's status, age or disability. http://www.verisk.com/careers.html Unsolicited resumes sent to Verisk, including unsolicited resumes sent to a Verisk business mailing address, fax machine or email address, or directly to Verisk employees, will be considered Verisk property. Verisk will NOT pay a fee for any placement resulting from the receipt of an unsolicited resume. Consumer Privacy Notice Privacy Policy share this job Other jobs at Wood Mackenzie Senior Software Engineer Boston, MA Senior DevOps Engineer Louisville, KY Senior Technology Operations Engineer Louisville, KY Show all jobs Similar jobs Senior Data Engineer with Azure & Python Talent Factor Ltd. Mumbai, India Senior Data Engineer (Remote, APAC) Shopify Singapore, Singapore Senior Data Engineer Pattern AI San Mateo, CA Powered by (Data Processor) Privacy Policy and Terms of Use Senior Data Engineer Edinburgh, UK Full-time
Please click here, if the job didn't load correctly.







Please wait. You are being redirected to the job in 3 seconds.