Senior Databricks Developer
Quick facts
- Pay
- $81/hour (C2C)
- Type
- Full-time
- Location
- Malvern, PA
- Skills
- Python, SQL, React, AWS, Machine Learning
- Industry
- Information Technology — 1359 open jobs
- Visa in listing
- H-1B, OPT
- Apply
- Free to apply — never pay anyone for a job offer or visa sponsorship
Job description
- Home
- About
- Adaptive AI
- Industries
- Consulting
- Jobs Portal
- Contact Us
- Home
- About
- Adaptive AI
- Industries
- Consulting
- Contact Us
Job Overview
- Job ID:
J54834
- Job Title:
Senior Databricks Developer
- Location:
Malvern, PA
- Duration:
12 Months + Extension
- Domain Exposure:
Consumer Staples
- Client:
To Be Discussed Later
- Employment Type:
W-2, 1099, C2C
- Work Authorization:
US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other
View All Jobs
Similar Jobs
- Senior GCP Platform Engineer - Woodland Hills, CA
- Senior Snowflake Data Warehouse Engineer / Data Engineer - Madison, WI
- Senior Full Stack Developer with React.js - Warren, MI
- Salesforce Senior Business Analyst - Atlanta, GA
- Senior SAP S/4HANA Functional Architect - Cincinnati, OH
We are seeking a Senior Databricks Developer with 7+ years of Data Engineering experience and deep expertise in Databricks, AWS, PySpark, Python, and SQL. This is a highly technical, hands-on engineering role within a data engineering team focused primarily on building, enhancing, and supporting enterprise data pipelines. The ideal candidate will have extensive experience developing cloud-native data solutions in AWS, implementing Delta Lake and Medallion architectures, and delivering scalable, production-grade data pipelines using Databricks. This is not a consulting role; we are looking for a developer who enjoys building and optimizing data platforms and solving complex data engineering challenges.
Responsibilities- Design, develop, and maintain large-scale ETL/ELT pipelines using Databricks, PySpark, Python, and SQL.
- Build scalable and highly reliable data ingestion, transformation, and orchestration frameworks within AWS.
- Develop and support Delta Lake implementations and Medallion Architecture (Bronze, Silver, Gold) data pipelines.
- Create and optimize batch and streaming pipelines that process large volumes of structured and unstructured data.
- Leverage AWS services including S3, Glue, Lambda, EMR, IAM, EventBridge, CloudWatch, Kinesis, and Redshift to support end-to-end data workflows.
- Optimize Spark jobs, Delta tables, and Databricks workloads for performance, scalability, and cost efficiency.
- Partner with Data Engineers, Architects, Analytics teams, and business stakeholders to deliver high-quality data solutions.
- Implement data quality controls, monitoring, alerting, and operational support processes.
- Troubleshoot and resolve complex production issues across Databricks and AWS environments.
- Contribute to engineering best practices, code reviews, automation, and platform modernization initiatives.
- 7+ years of Data Engineering experience building enterprise-scale data platforms and pipelines.
- 5+ years of hands-on Databricks development experience in production environments.
- Strong expertise in Python, PySpark, and SQL with a focus on pipeline development.
- Extensive experience developing and supporting data pipelines within AWS.
- Strong knowledge of Delta Lake, Lakehouse Architecture, and Medallion Architecture (Bronze, Silver, Gold).
- Hands-on experience with AWS services such as S3, Glue, Lambda, EMR, Redshift, Kinesis, IAM, and CloudWatch.
- Deep understanding of Spark architecture, distributed data processing, performance tuning, partitioning, and optimization.
- Experience building highly scalable batch and streaming data processing solutions.
- Strong understanding of data modeling, data warehousing concepts, and modern data architectures.
- Experience supporting production environments, monitoring data pipelines, and troubleshooting complex data issues.
- Experience with Databricks Workflows, Delta Live Tables (DLT), Unity Catalog, and Structured Streaming.
- Experience with Kafka, Airflow, or cloud-native orchestration frameworks.
- Experience implementing CI/CD pipelines using GitHub Actions, Jenkins, or Azure DevOps.
- Infrastructure as Code experience utilizing Terraform or CloudFormation.
- Databricks Certified Data Engineer Associate or Professional certification.
- Experience working within large enterprise AWS environments supporting mission-critical data platforms.
Apply Now
Equal Opportunity EmployerWe are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.
- Home
|
- About
|
- Adaptive AI
|
- Industries
|
- Consulting
|
- Contact Us
© 2004-2026, Machine Learning Technologies LLC, or its affiliates
Visa sponsorship record: Machine Learning Technologies LLC
Sponsors actively| Fiscal year | H-1B LCAs | USCIS approvals | USCIS denials | PERM |
|---|---|---|---|---|
| FY2026 | — | 7 | 0 | — |
| FY2025 | 20 | 1 | 0 | — |
| FY2024 | 20 | 4 | 0 | — |
✔ Machine Learning Technologies LLC filed 14 H-1B applications for this kind of role (Software Developers) in the period above.
Roles they sponsor most
- business analyst4 LCAs · median $71k
- java developer3 LCAs · median $85k
- accounts manager2 LCAs · median $60k
- application developer2 LCAs · median $115k
- cognitive implementation engineer2 LCAs · median $82k
Full sponsorship history of Machine Learning Technologies LLC →
Which visas can work for this job
Occupation: Software Developers (SOC 15-1252) — estimated from the job title.
- Mentioned in the listing
H-1B, OPT
- H-1B cap-exempt employer
Regular cap-subject employer — a new H-1B needs to win the lottery in March (unless you already hold cap-counted H-1B status).
- TN (citizens of Canada and Mexico)
This kind of role may fit the USMCA profession “Computer Systems Analyst (or Engineer, for engineering-degree holders)” — it depends on the actual duties. No lottery, no cap; you need the matching degree or license.
- E-3 (Australia) and H-1B1 (Chile, Singapore)
Same degree requirement as H-1B, but no lottery and a separate quota that is rarely filled.
- O-1 (extraordinary ability)
For candidates with awards, publications, press, a high salary or critical roles at distinguished organizations. No cap, no lottery; the employer files a petition.
- STEM OPT extension (F-1 students)
Requires an E-Verify employer. We didn't find this company in the E-Verify list — ask HR.
Salary vs prevailing wage
Level IV (fully competent)Software Developers · Philadelphia-Camden-Wilmington, PA-NJ-DE-MD. Annual prevailing wages set by the Department of Labor (OFLC).
| Level | Prevailing wage | H-1B lottery odds* |
|---|---|---|
| Level I | $91,874 | ~15% |
| Level II | $113,859 | ~31% |
| Level III | $135,824 | ~46% |
| Level IV | $157,810 | ~61% |
This job pays $168,480 a year (converted from an hourly rate, 2,080 hours) — that's Level IV (fully competent). In the wage-weighted H-1B lottery a Level IV registration gets 4 entries; estimated selection chance about 61% — better than average.
* Odds are DHS projections for the FY2027 wage-weighted lottery (actual results vary by year and employer). Since the FY2027 cap season the H-1B lottery is weighted by wage level: Level I = 1 entry, II = 2, III = 3, IV = 4. The level is set by the offered wage against the prevailing wage for the occupation and worksite. Separately, a $100,000 fee for new H-1B petitions for workers outside the US was announced in 2025; as of September 2026 a federal court ruling keeps it unenforceable while appeals continue — check the current status.
Sources: U.S. Department of Labor OFLC disclosure data (H-1B/H-1B1/E-3 LCA, PERM), OFLC prevailing wage data, USCIS H-1B Employer Data Hub, E-Verify participating employers. Data loaded: LCA FY2024–FY2026, PERM, USCIS Data Hub, OFLC wages; updated 2026-10-03. Employers are matched by name, so records of companies with similar names can occasionally be mixed up. This is general information, not legal advice — talk to an immigration attorney about your case.