AP

Principal AI Engineer

ApTask H-1B Information Technology Full-timeNew York City, NY 150 - 180 USD /YEAR
Posted Nov 3, 2026 · Expires Nov 24, 2026

Quick facts

Pay
150 - 180 USD /YEAR
Type
Full-time
Location
New York City, NY
Skills
Python, Java, C++, Rust, SQL, Docker
Industry
Information Technology — 1380 open jobs
Visa in listing
H-1B
Apply
Free to apply — never pay anyone for a job offer or visa sponsorship

Job description

Principal AI Engineer – Agentic AI / LLM

Location: New York City, NY

Work Arrangement: Hybrid – 3 Days Onsite per Week

Employment Type: Full-Time

Work Hours: Must overlap with EST

Experience: 8–14 Years (10+ Years Preferred)

Visa: H-1B Transfer Candidates Can Be Considered

About the Role:

We are seeking a highly experienced Principal AI Engineer – Agentic AI / LLM to lead the architecture, development, and production deployment of enterprise-scale Agentic AI and Generative AI solutions for Fortune 500 clients.

This is a highly hands-on engineering and technical leadership position requiring strong expertise in Python, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Model Context Protocol (MCP), AI agent orchestration, and cloud infrastructure.

The ideal candidate will have a strong software engineering foundation and proven experience designing, building, and deploying multiple production-grade AI agent systems.

You will own the complete AI engineering lifecycle, from architecture and data pipelines to backend services, agent orchestration, evaluation frameworks, cloud deployment, performance optimization, and ongoing production reliability.

Candidates should demonstrate actual production ownership of AI systems rather than experience limited to research, proof-of-concepts, or basic LLM integrations.

Key Responsibilities

  • Architect, design, and develop production-grade Agentic AI systems using LLMs, RAG, tool calling, and agent orchestration.
  • Build autonomous AI agents capable of reasoning, retrieval, planning, and executing secure enterprise actions.
  • Own end-to-end AI system development, including data pipelines, backend services, agent orchestration, evaluation, observability, and cloud infrastructure.
  • Design and implement advanced RAG pipelines covering document ingestion, chunking strategies, embeddings, vector search, hybrid retrieval, reranking, and response validation.
  • Build and integrate MCP (Model Context Protocol) servers and secure tool-calling interfaces to connect AI agents with enterprise applications and business systems.
  • Develop multi-agent workflows using LangGraph, Google ADK, CrewAI, Claude Agent SDK, or equivalent frameworks.
  • Implement agent state management, planning, reasoning, tool execution, and human-in-the-loop workflows.
  • Build AI guardrails, validators, policy checks, deterministic fallbacks, self-correction loops, circuit breakers, and rollback strategies.
  • Develop LLM evaluation frameworks, including offline evaluation datasets, automated testing, continuous evaluation, and regression detection.
  • Implement LLM observability, tracing, and monitoring using LangSmith, Langfuse, or equivalent platforms.
  • Optimize AI applications for token consumption, context-window utilization, latency, cost, throughput, and scalability.
  • Design and maintain scalable backend services, APIs, microservices, and distributed systems.
  • Develop and maintain high-quality, production-ready Python and SQL code.
  • Deploy and operate AI applications using AWS, Azure, or GCP.
  • Implement CI/CD pipelines and infrastructure-as-code using Terraform or CloudFormation.
  • Collaborate with product, engineering, data science, and business stakeholders to translate business requirements into scalable technical solutions.
  • Provide technical leadership, conduct architecture and code reviews, establish engineering standards, and mentor engineering teams.

Required Qualifications:

1. Software Engineering & Technical Foundation

  • 8–14 years of professional software engineering experience, with 10+ years preferred.
  • Strong hands-on experience developing large-scale applications using Python.
  • Strong understanding of data structures, algorithms, and software engineering fundamentals.
  • Experience designing and developing APIs, microservices, and distributed systems.
  • Hands-on experience building and operating production-grade data pipelines.
  • Strong knowledge of system architecture, scalability, and performance optimization.
  • Experience with at least one additional backend or systems programming language, such as Go, Rust, Java, C, or C++, is highly desirable.

2. LLM & Generative AI Engineering

  • 2+ years of hands-on LLM/Generative AI engineering experience.
  • Experience designing, developing, and deploying production-grade LLM applications.
  • Demonstrated experience building and taking multiple Agentic AI systems into production.
  • Strong understanding of LLM architecture, prompt engineering, context management, and model behavior.
  • Experience integrating modern LLM APIs and enterprise AI platforms.

3. Agentic AI & Frameworks

Hands-on production experience with one or more of the following:

  • LangGraph
  • Google ADK
  • CrewAI
  • Claude Agent SDK
  • Other equivalent production-grade agent frameworks

Strong understanding and implementation experience in:

  • Agent orchestration and state management.
  • Planning and reasoning workflows.
  • Tool execution and function calling.
  • Multi-agent architectures and workflows.
  • Human-in-the-loop patterns.
  • Multi-step autonomous AI workflows.
  • Agent reliability, error handling, and failure recovery.

4. MCP & Enterprise Tool Integration

  • Strong hands-on experience with Model Context Protocol (MCP).
  • Experience building and deploying MCP servers.
  • Experience developing secure tool interfaces for AI agents.
  • Understanding of function calling, tool calling, and API integrations.
  • Experience securely connecting AI agents with enterprise applications and business systems.

5. RAG, Embeddings & Vector Databases

Strong understanding of RAG architecture from first principles, including:

  • Document ingestion and processing.
  • Chunking strategies and optimization.
  • Embeddings generation.
  • Vector search and semantic retrieval.
  • Hybrid retrieval.
  • Reranking techniques.
  • Retrieval optimization.
  • Context construction and management.
  • Response validation and grounding.

Experience with one or more vector databases:

  • Pinecone
  • Milvus
  • Weaviate
  • FAISS
  • OpenSearch
  • Other vector databases or cloud equivalents.

6. LLM Evaluation, Observability & Reliability

  • Experience building LLM evaluation frameworks.
  • Offline evaluation datasets and automated evaluation.
  • Continuous/online evaluation and regression testing.
  • AI quality measurement and performance monitoring.
  • LLM observability, tracing, and instrumentation.
  • Experience with LangSmith, Langfuse, or equivalent platforms.
  • Experience implementing AI guardrails, validators, fallback mechanisms, and reliability patterns.

7. Cloud Infrastructure & DevOps

Strong AWS experience is preferred, including:

  • Amazon EKS / ECS
  • AWS Lambda
  • Amazon S3
  • DynamoDB
  • Amazon Redshift
  • AWS Step Functions
  • Amazon Bedrock

Additional experience with:

  • Azure or GCP.
  • Docker and Kubernetes.
  • Terraform or CloudFormation.
  • CI/CD pipelines.
  • Infrastructure-as-code.
  • Cloud deployment and production operations.

8. AI Performance & Cost Optimization

Experience optimizing production LLM and Agentic AI systems through:

  • Token consumption optimization.
  • Context-window management.
  • Context shaping, pruning, and compaction.
  • Model routing.
  • Caching strategies.
  • Batching and streaming.
  • Parallel tool calls.
  • Latency optimization.
  • Cost and throughput optimization.
  • Performance testing against defined service-level objectives (SLOs).

Preferred Qualifications

  • Experience with Amazon Bedrock, Azure AI, or Google Vertex AI.
  • Experience building enterprise-scale AI platforms.
  • Experience working in enterprise or regulated environments.
  • Strong knowledge of scalable distributed systems and backend architectures.
  • Strong analytical, problem-solving, and debugging skills.
  • Ability to translate ambiguous business requirements into technical architecture.
  • Strong client-facing communication and stakeholder management skills.
  • Demonstrated technical leadership, architecture ownership, and mentoring experience.

Visa sponsorship record

No public sponsorship records found

We didn't find H-1B, H-1B1, E-3 or green card (PERM) filings under the name ApTask in the Department of Labor and USCIS data. That doesn't mean the job can't be sponsored — the company may file under a different legal name, be new to sponsorship, or sponsor a visa that isn't in these datasets (for example H-2B or J-1).

Tip: ask the recruiter early, in writing, which visa they sponsor and whether they cover the legal and filing fees.

Which visas can work for this job

Occupation: Software Developers (SOC 15-1252).

  • Mentioned in the listing

    H-1B

  • H-1B cap-exempt employer

    Regular cap-subject employer — a new H-1B needs to win the lottery in March (unless you already hold cap-counted H-1B status).

  • TN (citizens of Canada and Mexico)

    This kind of role may fit the USMCA profession “Computer Systems Analyst (or Engineer, for engineering-degree holders)” — it depends on the actual duties. No lottery, no cap; you need the matching degree or license.

  • E-3 (Australia) and H-1B1 (Chile, Singapore)

    Same degree requirement as H-1B, but no lottery and a separate quota that is rarely filled.

  • O-1 (extraordinary ability)

    For candidates with awards, publications, press, a high salary or critical roles at distinguished organizations. No cap, no lottery; the employer files a petition.

  • STEM OPT extension (F-1 students)

    Requires an E-Verify employer. We didn't find this company in the E-Verify list — ask HR.

Salary vs prevailing wage

Software Developers · New York-Newark-Jersey City, NY-NJ. Annual prevailing wages set by the Department of Labor (OFLC).

L1L2L3L4
LevelPrevailing wageH-1B lottery odds*
Level I$109,845~15%
Level II$137,717~31%
Level III$165,589~46%
Level IV$193,461~61%

The listing has no salary, so we can't place it on a wage level. Ask the employer which wage level they'd file at: Level III–IV registrations get 3–4 entries in the H-1B lottery.

* Odds are DHS projections for the FY2027 wage-weighted lottery (actual results vary by year and employer). Since the FY2027 cap season the H-1B lottery is weighted by wage level: Level I = 1 entry, II = 2, III = 3, IV = 4. The level is set by the offered wage against the prevailing wage for the occupation and worksite. Separately, a $100,000 fee for new H-1B petitions for workers outside the US was announced in 2025; as of September 2026 a federal court ruling keeps it unenforceable while appeals continue — check the current status.

Sources: U.S. Department of Labor OFLC disclosure data (H-1B/H-1B1/E-3 LCA, PERM), OFLC prevailing wage data, USCIS H-1B Employer Data Hub, E-Verify participating employers. Data loaded: LCA FY2024–FY2026, PERM, USCIS Data Hub, OFLC wages; updated 2026-10-03. Employers are matched by name, so records of companies with similar names can occasionally be mixed up. This is general information, not legal advice — talk to an immigration attorney about your case.

Get new Information Technology jobs by emailOne email a day, only when there are new jobs. Unsubscribe in one click.