Bigdata Hadoop Administrator
Quick facts
- Type
- Full-time
- Location
- Berkley Heights, NJ
- Skills
- Python, Scala, Kubernetes, Linux
- Industry
- Manufacturing and Logistics — 98 open jobs
- Visa in listing
- H-1B, OPT
- Apply
- Free to apply — never pay anyone for a job offer or visa sponsorship
Job description
Job ID: J53565 Job Title: Bigdata Hadoop Administrator Location: Berkeley Heights, NJ Duration: 16 Months + Extension Domain Exposure: Manufacturing Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, L2-EAD, GC-EAD Client: To Be Discussed Later Employment Type: W-2, 1099, C2C
Job Summary: 10+ years solid experience with deploying, configuring, monitoring, and troubleshooting Apache Spark clusters and associated big data frameworks (such as Hadoop, Kafka, or cloud-based data platforms) to ensure high availability and performance.
Key Responsibilities: Focuses on cluster health, performance tuning, and production data pipelines.
Technical Experience: Deep hands-on experience with Apache Spark architecture (Driver, Workers, Executors, RDDs/Data Frames) and cluster managers (YARN, Kubernetes, or Mesos).
OS & Scripting: Strong proficiency in Linux/Unix administration and scripting languages (Bash, Python, or Scala).
Ecosystem Knowledge: Familiarity with big data and streaming tools like Hadoop HDFS, Kafka, Hive, or monitoring suites (Splunk, Prometheus, Grafana).
Debugging Skills: Strong analytical capabilities to inspect logs, thread dumps, and metrics under heavy production loads
Excellent coordination with stakeholders and communication skills
Must have experience with below responsibilities:
- Cluster Management: Install, configure, and maintain Apache Spark clusters and node infrastructure in production and staging environments.
- Performance & Monitoring: Monitor cluster health, resource utilization (CPU, memory), and execution logs using tools like Spark UI, Splunk, or Elastic. Identify bottlenecks and optimize job execution times.
- Troubleshooting: Diagnose and resolve out-of-memory errors, executor failures, shuffle issues, and node crashes in distributed workloads.
- Pipeline & Integration Support: Support data engineers and developers in managing Spark applications, streaming jobs, and integrations with message brokers like Kafka.
- Security & Access Control: Implement security principles, role-based access control, authentication, and data encryption across the cluster.
- Backup & Disaster Recovery: Execute backup, recovery, and failover plans for Spark applications, configurations, and critical data stores.
- Patching & Upgrades: Apply software patches, driver updates, and version upgrades with minimal disruption to ongoing production jobs
Equal Opportunity Employer
We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/immigration status, veteran status, or any other status protected under federal, state, or local law.
Visa sponsorship record: Robotics Technologies LLC
Sponsors actively| Fiscal year | H-1B LCAs | USCIS approvals | USCIS denials | PERM |
|---|---|---|---|---|
| FY2026 | 86 | 30 | 5 | — |
| FY2025 | 82 | 8 | 0 | — |
| FY2024 | 36 | 11 | 0 | — |
Also filed: H-1B1 Singapore × 1 — a good sign for Australian (E-3), Chilean and Singaporean (H-1B1) candidates.
Roles they sponsor most
- data analyst22 LCAs · median $90k
- software developer13 LCAs · median $84k
- software engineer10 LCAs · median $84k
- business analyst8 LCAs · median $80k
- data engineer7 LCAs · median $98k
Which visas can work for this job
- Mentioned in the listing
H-1B, OPT
- H-1B cap-exempt employer
Regular cap-subject employer — a new H-1B needs to win the lottery in March (unless you already hold cap-counted H-1B status).
- O-1 (extraordinary ability)
For candidates with awards, publications, press, a high salary or critical roles at distinguished organizations. No cap, no lottery; the employer files a petition.
Sources: U.S. Department of Labor OFLC disclosure data (H-1B/H-1B1/E-3 LCA, PERM), OFLC prevailing wage data, USCIS H-1B Employer Data Hub, E-Verify participating employers. Data loaded: LCA FY2024–FY2026, PERM, USCIS Data Hub, OFLC wages; updated 2026-10-03. Employers are matched by name, so records of companies with similar names can occasionally be mixed up. This is general information, not legal advice — talk to an immigration attorney about your case.