Data Engineer – Databricks & Cloud AI
Location: Hybrid (Remote with occasional onsite as needed)
Clearance: Must be eligible for Public Trust

We are seeking a skilled and innovative Data Engineer with at least 6 years of experience designing and implementing large-scale data solutions. The ideal candidate will bring deep expertise in Databricks, a strong foundation in AI/ML infrastructure, and a passion for solving complex data challenges in a hybrid federal environment.

Key Responsibilities:

• Design, build, and optimize scalable data pipelines using Databricks and modern data tools.
• Collaborate with data scientists and ML engineers to support AI-driven analytics and workflows.
• Develop and maintain robust data architectures for both real-time and batch processing.
• Apply best practices for data security, governance, and compliance aligned with federal standards.
• Integrate structured and unstructured data sources to enable high-quality business insights.
• Monitor and troubleshoot performance issues, optimizing data processing systems.
• Work with cross-functional teams to translate business needs into technical data solutions.

Required Skills & Qualifications:

• 6+ years of professional experience in data engineering.
• Bachelor’s degree in Computer Science, Information Technology, Engineering, Data Science, or a related field.
• Proven expertise with Databricks, Apache Spark, and distributed computing frameworks.
• Strong experience with cloud platforms (AWS, Azure, or GCP preferred).
• Demonstrated experience supporting AI or machine learning infrastructure.
• Proficiency in Python, SQL, and version control systems such as Git.
• Experience with ETL/ELT processes and orchestration tools (e.g., Airflow, dbt).
• Excellent communication skills and ability to collaborate across teams.
• Must be able to obtain and maintain a Public Trust clearance.

Work Environment:

This is a hybrid role requiring occasional onsite presence based on project or client needs. Candidates must reside in the U.S. and be willing to work onsite as needed.