Sr. Data Engineer Details

Sr. Data Engineer

Bigbear.ai - San Diego, CA

Employment Type : Full-Time

Overview:
Bigbear.ai is seeking an experienced Senior Data Engineer to join our product team. This position is responsible for the entire life cycle - design, implementation, service operations, and maintenance of data pipelines. We are looking for a self-starter that has extensive data engineering experience and enjoys solving challenging problems.
This is an opportunity to be part of one of the fastest growing AI/ML companies in the industry. At BigBear.ai, we're in this business together. We own it, we make it thrive, and we enjoy the challenges of our work. We know that our employees play the largest role in our continual success. That is why we foster an environment of growth and development, with an emphasis on opportunity, recognition, and work-life balance. We give the same high level of commitment to our employees that we give to our clients. If BigBear.ai sounds like the place where you want to be, we'd enjoy speaking with you.
This position can be located in San Diego, CA; Chantilly, VA; or possibly remote.
What you will do:

• Design/Build orchestration processes for data pipelines, workflows using open source, COTS and/or custom-built orchestration tools.
• Participate in design of infrastructure, data architecture, and data warehouse to support Data Science teams and other applications.
• Build automation process to deploy scalable, on-demand data compute infrastructure.
• Research/Evaluate emerging technologies/tool sets to accelerate/improve development process.
• Identify ways to improve data reliability, efficiency, and quality.

What you need to have:

• 7+ years of experience as a data engineer with a passion for cloud technology.
• 5+ years of experience with lake house designs and data warehouse modeling.
• 3+ years of experience with data pipeline orchestration using tools such as Apache Airflow, Apache HOP, prefect, Luigi or equivalent.
• 3+ years of experience with one or more of the following: Apache Spark, Databricks, Snowflake, AWS EMR.
• Demonstrated proficiency with at least one modern general-purpose programming languages (Java, Go, Python, Scala, etc.)
• Solid experience in Linux environment.
• Ability to work with a variety of teams and be passionate about building cutting-edge solutions to solve problems with the right technologies.
• Knowledge of professional data engineering practices & best practices including coding standards, code reviews, testing, deployment and operations.
• Bachelor's degree in Computer Science or a similar technical field or equivalent practical experience.

What we'd like you to have:

• Experience building microservice API.
• Expert in various database technology stacks as well as NoSQL and Hadoop.
• Solid understanding of AWS technology (EC2, S3, Lambda, EKS, ELB, EMR).
• Experience working with Tensorflow.
• Experience working in an architecture using containers (Kubernetes/Docker).
• Experience in communicating with users, other technical teams, and management to collect requirements, describe software product features, and technical designs.
• Experience with automated deployments and source code/configuration management tools.
• GitHub, AWS Cloudformation, Jenkins, Chef, Puppet, Vagrant, Terraform, etc.

About BigBear.ai:
A leader in decision dominance for more than 20 years, BigBear.ai operationalizes artificial intelligence and machine learning at scale through its end-to-end data analytics platform. The Company uses its proprietary AI/ML technology to support its customers’ decision-making processes and deliver practical solutions that work in complex, realistic and imperfect data environments. BigBear.ai’s composable AI-powered platform solutions work together as often as they stand alone: Observe (data ingestion and conflation), Orient (composable machine learning at scale), and Dominate (visual anticipatory intelligence and optimization).

BigBear.ai’s customers, which include the U.S. Intelligence Community, Department of Defense, the U.S. Federal Government, as well as customers in the commercial sector, rely on BigBear.ai’s high value software products and technology to analyze information, identify and manage risk, and support mission critical decision making. Headquartered in Columbia, Maryland, BigBear.ai has additional locations in Virginia, Massachusetts, Michigan, and California.

BigBear.ai will request COVID-19 vaccination status information as part of the onboarding process.
Location: 4655 Executive Drive,Suite 200, San Diego, CA 92121

Location: 4655 Executive Drive,Suite 200, San Diego, CA 92121

Job Type: Full-time