Senior Data Engineer
Quick facts
- Type
- Full-time
- Location
- Atlanta, GA
- Experience
- 6+ years
- Skills
- Python, Java, Scala, SQL, Kubernetes, Machine Learning
- Industry
- Information Technology — 1396 open jobs
- Visa in listing
- H-1B, OPT
- Apply
- Free to apply — never pay anyone for a job offer or visa sponsorship
Job description
- Home
- About
- Adaptive AI
- Industries
- Consulting
- Jobs Portal
- Contact Us
- Home
- About
- Adaptive AI
- Industries
- Consulting
- Jobs Portal
- Contact Us
Job Overview
- Job ID:
J53450
- Job Title:
Senior Data Engineer
- Location:
Atlanta, GA
- Duration:
12 Months + Extension
- Domain Exposure:
Aerospace/ Airlines
- Work Authorization:
US Citizen,Green Card,OPT-EAD,CPT,H-1B,H4-EAD,L2-EAD,GC-EAD
- Client:
To Be Discussed Later
- Employment Type:
W-2, 1099, C2C
View All Jobs
Similar Jobs
- Senior ServiceNow Developer - Atlanta, GA
- Senior Salesforce Engineer - Raleigh, NC
- Senior Lead .NET Full Stack Developer - Phoenix, AZ
- Senior SDET - Chicago, IL
- Senior Salesforce Engineer - Raleigh, NC
- Build and operate production-grade batch and streaming data pipelines across SQL Server, cloud applications, device/event streams, Customer Relationship Management systems, and third-party sources.
- Develop ingestion, transformation, and enrichment pipelines using Apache Flink, Kafka, Change Data Capture, SQL, and Python/Java/Scala.
- Implement lakehouse data layers across landing, raw, conformed, and consumption zones using Apache Iceberg and Trino.
- Build dimensional and analytical models for entities such as buildings, tenants, credentials, devices, and people.
- Implement robust handling for Change Data Capture, late-arriving data, retries, backfills, replay, schema evolution, and data reconciliation.
- Build and maintain integration between the lakehouse and Snowflake, including Iceberg-backed/external tables, secure sharing, and downstream data contracts.
- Develop automated data-quality checks, pipeline monitoring, lineage, freshness alerts, and operational dashboards.
- Troubleshoot and resolve production data issues, pipeline failures, performance bottlenecks, and data-quality problems.
- Optimize SQL queries, storage layouts, partitioning, clustering, compute utilization, and overall platform cost.
- Implement security controls including role-based access, row/column-level security, masking, and protection of sensitive data.
- Build and maintain Continuous Integration and Continuous Deployment pipelines, automated testing, infrastructure-as-code, and environment promotion processes.
- Participate in production support, incident resolution, Root Cause Analysis, deployment, and on-call activities.
- Work closely with Product, Application Engineering, Quality Assurance, DevOps/Site Reliability Engineering, Analytics, and globally distributed engineering teams.
- Contribute to technical design decisions and documentation while remaining primarily hands-on in implementation and production delivery.
- 6+ years of hands-on experience in data engineering, data warehousing, or data platform development.
- Strong production experience building and supporting end-to-end data pipelines.
- Expert SQL, including complex queries, query-plan analysis, and performance tuning.
- Strong development skills in Python, Java, or Scala.
- Hands-on experience with Apache Iceberg, Delta Lake, or Apache Hudi.
- Experience with distributed query technologies such as Trino, Presto, or Spark SQL.
- Hands-on Snowflake experience, including data modeling, performance optimization, external/Iceberg tables, secure data sharing, or access management.
- Experience with streaming and Change Data Capture technologies such as Apache Flink, Kafka, Spark Structured Streaming, or Debezium.
- Strong understanding of dimensional modeling, data quality, schema evolution, and data contracts.
- Experience with Kubernetes, containers, Continuous Integration and Continuous Deployment, and infrastructure-as-code.
- Experience implementing monitoring, alerting, lineage, reconciliation, and operational support for production data platforms.
- Ability to independently troubleshoot complex production issues and drive them through resolution.
- Experience with multi-tenant Software as a Service data platforms and customer data isolation.
- Experience integrating open lakehouse platforms with Snowflake.
- Azure cloud experience.
- Experience with Airflow, Dagster, dbt, Power BI, Looker, or Superset.
- Experience with data governance, cataloging, masking, and access-control frameworks.
- Exposure to Internet of Things/device telemetry, physical security, commercial real estate, or property technology.
- Experience using Artificial Intelligence-assisted engineering tools to accelerate data development.
Apply Now
Equal Opportunity Employer
We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.
- Home
|
- About
|
- Adaptive AI
|
- Industries
|
- Consulting
|
- Contact Us
© 2008-2018, Machine Learning Technologies LLC. All Rights Reserved.
Visa sponsorship record: Machine Learning Technologies LLC
Sponsors actively| Fiscal year | H-1B LCAs | USCIS approvals | USCIS denials | PERM |
|---|---|---|---|---|
| FY2026 | — | 7 | 0 | — |
| FY2025 | 20 | 1 | 0 | — |
| FY2024 | 20 | 4 | 0 | — |
✔ Machine Learning Technologies LLC filed 2 H-1B applications for this kind of role (Software Developers, Systems Software) in the period above.
Roles they sponsor most
- business analyst4 LCAs · median $71k
- java developer3 LCAs · median $85k
- accounts manager2 LCAs · median $60k
- application developer2 LCAs · median $115k
- cognitive implementation engineer2 LCAs · median $82k
Full sponsorship history of Machine Learning Technologies LLC →
Which visas can work for this job
Occupation: Software Developers, Systems Software (SOC 15-1133).
- Mentioned in the listing
H-1B, OPT
- H-1B cap-exempt employer
Regular cap-subject employer — a new H-1B needs to win the lottery in March (unless you already hold cap-counted H-1B status).
- TN (citizens of Canada and Mexico)
This role doesn't clearly match a profession on the USMCA (TN) list.
- E-3 (Australia) and H-1B1 (Chile, Singapore)
Same degree requirement as H-1B, but no lottery and a separate quota that is rarely filled.
- O-1 (extraordinary ability)
For candidates with awards, publications, press, a high salary or critical roles at distinguished organizations. No cap, no lottery; the employer files a petition.
- STEM OPT extension (F-1 students)
Requires an E-Verify employer. We didn't find this company in the E-Verify list — ask HR.
Salary vs prevailing wage
Prevailing wage data for this occupation and location isn't loaded yet.
Sources: U.S. Department of Labor OFLC disclosure data (H-1B/H-1B1/E-3 LCA, PERM), OFLC prevailing wage data, USCIS H-1B Employer Data Hub, E-Verify participating employers. Data loaded: LCA FY2024–FY2026, PERM, USCIS Data Hub, OFLC wages; updated 2026-10-03. Employers are matched by name, so records of companies with similar names can occasionally be mixed up. This is general information, not legal advice — talk to an immigration attorney about your case.