Senior Data Engineer
Quick facts
- Type
- Full-time
- Location
- New York, NY
- Experience
- 6+ years
- Skills
- Python, Java, Machine Learning
- Industry
- Information Technology — 1388 open jobs
- Visa in listing
- H-1B, OPT
- Apply
- Free to apply — never pay anyone for a job offer or visa sponsorship
Job description
- Home
- About
- Adaptive AI
- Industries
- Consulting
- Jobs Portal
- Contact Us
- Home
- About
- Adaptive AI
- Industries
- Consulting
- Contact Us
Job Description
Job Overview
- Job ID:
J53604
- Job Title:
Senior Data Engineer
- Location:
New York, NY
- Duration:
12 Months + Extension
- Domain Exposure:
Media/ Entertainment
- Work Authorization:
US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, L2-EAD, GC-EAD
- Client:
To Be Discussed Later
- Employment Type:
W-2, 1099, C2C
View All Jobs
Similar Jobs
- Senior Business Analyst - Irvine, CA
- Senior SailPoint IAM Architect - Rosemead, CA
- Senior Java Backend Developer - Phoenix, AZ
- Senior Machine Learning Engineer - San Jose, CA
- Senior Cloud-Native Application Architect - Dallas, TX
Job Description
We are looking for an experienced Senior Data Engineer to join our Enrolment as a Product Platform team. The candidate will contribute to building a modern, scalable healthcare enrollment data platform using Databricks.
The immediate priority is developing and delivering X12 EDI 837/835 processing capabilities. The ideal candidate should have strong hands-on experience with Databricks, PySpark, Python, and healthcare EDI standards.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using Databricks.
- Build and support X12 EDI processing capabilities, particularly 837, 835, and 834 transactions.
- Develop high-volume, production-grade data engineering solutions.
- Work with Delta Lake, Apache Spark, Databricks Notebooks, and Pipelines.
- Process and transform healthcare enrollment, eligibility, and claims-related data.
- Ensure data security and compliance with HIPAA guidelines, including PII and PHI handling.
- Troubleshoot, optimize, and maintain existing data pipelines.
- Work independently in a fast-paced program environment.
Required Skills:
- 6+ years of experience in Data Engineering.
- Strong hands-on experience with Databricks (Delta Lake, Spark, Notebooks, Pipelines).
- Strong working knowledge of X12 EDI standards – 837, 835, and 834.
- Proficiency in Python and PySpark.
- Experience building and maintaining high-volume, production-grade data pipelines.
- Healthcare domain experience with knowledge of PII, PHI, and HIPAA compliance.
- Familiarity with healthcare enrollment and eligibility data workflows.
- Ability to work independently and deliver in a fast-paced environment.
Good To Have:
- Previous experience with healthcare clearinghouse integrations.
- Experience with healthcare EDI transaction processing and integrations.
Apply Now
Equal Opportunity Employer
We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.
- Home
|
- About
|
- Adaptive AI
|
- Industries
|
- Consulting
|
- Contact Us
© 2008-2018, Machine Learning Technologies LLC. All Rights Reserved.
Visa sponsorship record: Machine Learning Technologies LLC
Sponsors actively| Fiscal year | H-1B LCAs | USCIS approvals | USCIS denials | PERM |
|---|---|---|---|---|
| FY2026 | — | 7 | 0 | — |
| FY2025 | 20 | 1 | 0 | — |
| FY2024 | 20 | 4 | 0 | — |
✔ Machine Learning Technologies LLC filed 2 H-1B applications for this kind of role (Software Developers, Systems Software) in the period above.
Roles they sponsor most
- business analyst4 LCAs · median $71k
- java developer3 LCAs · median $85k
- accounts manager2 LCAs · median $60k
- application developer2 LCAs · median $115k
- cognitive implementation engineer2 LCAs · median $82k
Full sponsorship history of Machine Learning Technologies LLC →
Which visas can work for this job
Occupation: Software Developers, Systems Software (SOC 15-1133).
- Mentioned in the listing
H-1B, OPT
- H-1B cap-exempt employer
Regular cap-subject employer — a new H-1B needs to win the lottery in March (unless you already hold cap-counted H-1B status).
- TN (citizens of Canada and Mexico)
This role doesn't clearly match a profession on the USMCA (TN) list.
- E-3 (Australia) and H-1B1 (Chile, Singapore)
Same degree requirement as H-1B, but no lottery and a separate quota that is rarely filled.
- O-1 (extraordinary ability)
For candidates with awards, publications, press, a high salary or critical roles at distinguished organizations. No cap, no lottery; the employer files a petition.
- STEM OPT extension (F-1 students)
Requires an E-Verify employer. We didn't find this company in the E-Verify list — ask HR.
Salary vs prevailing wage
Prevailing wage data for this occupation and location isn't loaded yet.
Sources: U.S. Department of Labor OFLC disclosure data (H-1B/H-1B1/E-3 LCA, PERM), OFLC prevailing wage data, USCIS H-1B Employer Data Hub, E-Verify participating employers. Data loaded: LCA FY2024–FY2026, PERM, USCIS Data Hub, OFLC wages; updated 2026-10-03. Employers are matched by name, so records of companies with similar names can occasionally be mixed up. This is general information, not legal advice — talk to an immigration attorney about your case.