A PHP Error was encountered

Severity: Notice

Message: MemcachePool::get(): Server 127.0.0.1 (tcp 11211, udp 0) failed with: Connection refused (111)

Filename: drivers/Cache_memcached.php

Line Number: 142

Backtrace:

File: /home/theinjobs/public_html/application/controllers/Indeed.php
Line: 536
Function: get

File: /home/theinjobs/public_html/index.php
Line: 316
Function: require_once

Data Engineer Job In Archer Daniels Midland Company At Erlanger,

Data Engineer

  • Full-Time
  • Erlanger, KY
  • Archer Daniels Midland Company
  • Posted 2 years ago – Accepting applications
Job Description

Data Engineer
This is an exempt level position.

Summary:
Data Engineer will work on designing, building, and implementing data foundations to support strategic analytics projects that drive strategic growth for ADM. This involves liaising with functional teams that build or acquire the underlying data, application owners to understand raw or source data structures, and end users to accurately design strategic data marts. Finally, designing and building data pipelines, ETL/ELT integrations, constructing and modifying data marts, preparing (cleaning, transforming) data, and collaborating with extended team members to design impactful business solutions. Data Engineer needs to have expert technical knowledge of platforms and software technology (ETL/ELT, SQL, Power BI, Python), deep expertise in data management techniques, ability to drive effective support of data analysis and model management, and experience with IT project management practices

Responsibilities:
  • Standardize data and reporting across businesses and teams to enable consistency and quality of key business data
  • Design and develop enterprise data warehouse platform that conforms to consistent methodologies, standards and industry best practices
  • Design, develop, test and document data integrations and assist with deployment, validation and hypercare
  • Maintain and support ETL/ELT integrations using technical documentation
  • Participate in designing overall logical & physical data warehouse and data mart models and architectures to support business requirements
  • Develop and maintain SQL, PL/SQL, Python code as needed
  • Assist with review to confirm technical feasibility of integration development objects based on integration principles and best practices
  • Understand and navigate a wide array of source data systems (enterprise data warehouses, relational databases, IT systems, in house and COTS applications, documents, APIs, unstructured data, big data, NoSQL databases, etc.)
  • Analyze data and assist with developing insights (e.g., via data visualization tools like Power BI / SAC) to enable business decision making
  • Propose new methodologies to demonstrate data to improve existing methodologies
  • Developing prototypes and proof of concepts for required solutions
  • Implementing information security standards in enterprise data warehouse
  • Prepare and present ideas and recommendations to colleagues and management
  • Document solutions through high/low level design documentation
  • Learn new groundbreaking data engineering and analytic tools as needed
  • Contribute to development of the overall solution approach
  • Recommend solutions to address gaps
  • Assist with development estimation
  • Supervise and review activities of consultants

Requirements:
  • 4-year Bachelor’s degree or equivalent in IT, Computer Science, Science, Engineering, Statistics, Programming, Business Analytics, Mathematical or related field
  • At least 6 years of enterprise BI and Analytics technical experience implementing data warehouse and data marts in an Agile environment
  • 5 years of recent experience using data integration, ETL, ELT, data replication, and data warehouse automation tools such as Qlik Replicate, Qlik Compose, Microsoft Azure Data Factory, Oracle Data Integrator, Informatica Power Center or Microsoft SQL Server Integration Services
  • 5 years of recent experience in data processing using SQL, Python
  • Experience sourcing data from ERP data sources, e.g., SAP, JD Edwards, PeopleSoft, Oracle EBS in support of analytic product development and business transformation projects
  • Experience with MPP systems, Azure Synapse preferred
  • Experience with databases like Microsoft SQL Server, Oracle
  • Experience delivering Cloud based Data Solutions in Azure
  • Experience with Data Virtualization technologies and tools, Denodo preferred
  • Working knowledge of BI architecture, dimensional modeling, data warehousing best practices, and data integration standard methodologies
  • Experience in delivering solutions using iterative development methodologies like Agile, KanBan, DevOps
  • Experience working with Big Data technologies such as Spark, Kafka, DataBricks, Hive, or equivalent
  • Experience with visualization technologies and services including Microsoft Power BI, SAP Analytics Cloud, Oracle Business Intelligence is a plus
  • Working knowledge of Python ML libraries like Scikit-learn/PyTorch or Azure ML
  • Experience working in DevOps / CICD framework is a plus
  • Experience with metadata management discipline and practices using Information Steward is a plus
  • High accountability with a demonstrated ability to deliver
  • Strong communication skills including design documentation
  • Strong collaboration skills working with architecture, design and development teams

This position offers a complete benefit package, including 401K/ESOP, pension, health, life and dental insurance.
ADM is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age disability and veteran status.
LI-AK1

About ADM:

At ADM, we unlock the power of nature to provide access to nutrition worldwide. With industry-advancing innovations, a complete portfolio of ingredients and solutions to meet any taste, and a commitment to sustainability, we give customers an edge in solving the nutritional challenges of today and tomorrow. We’re a global leader in human and animal nutrition and the world’s premier agricultural origination and processing company. Our breadth, depth, insights, facilities and logistical expertise give us unparalleled capabilities to meet needs for food, beverages, health and wellness, and more. From the seed of the idea to the outcome of the solution, we enrich the quality of life the world over. Learn more at www.adm.com.

EEO

ADM is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability and veterans status.

Ref ID

#LI-NA1
Apply to this Job