[Englewood Cliffs, NJ & Plano, TX] 백엔드 엔지니어 – AI Gateway
계약: 1년 + 연장 또는 정규직 전환 기회
근무지: Englewood Cliffs, NJ (2026년 9월까지) → Plano, TX (2026년 10월부터)
근무시간: 09:00 ~ 18:00 (현지시간)
급여: $10,150/월 (경력 및 자격에 따라 협의)
복리후생: Medical / Vision / Dental / PTO (입사 후 90일 이후 적용)
채용인원: 1명
※ 2026년 10월부터 Texas(Plano)로 이전 가능하며, 9월까지 NJ 현장 근무가 가능한 지원자​를 모집합니다.

포지션 개요
기업 고객과 LLM/AI 서비스 간의 트래픽을 라우팅·검사·제어하는 고성능 AI Gateway를 개발 및 운영합니다. 대규모 동시 스트리밍 연결을 안정적으로 처리하기 위한 Async Python, Network Programming 및 Cloud Infrastructure 전문성을 필요로 합니다.

주요 자격요건
Async Python / Network Programming 3년+
asyncio, aiohttp/anyio, TCP/UDP, WebSocket, SSE
TLS, Connection Pooling, Keep-alive, Zero-copy Buffering
Streaming / Large-Payload
Chunked Transfer, Bidirectional Streaming, Back-pressure, High-throughput 처리
Backend / Protocol
FastAPI 기반 Backend 개발 3년+
REST/Streaming API, Pydantic, OpenAPI
HTTP/2, HTTP/3, gRPC, HPACK 이해
Cloud / Kubernetes
Docker, AKS/EKS/GKE, HPA/VPA, Rolling Update
Istio/Envoy 등 Service Mesh 경험
Messaging / Database / Security
Redis Streams, RabbitMQ 또는 Kafka
PostgreSQL, PgBouncer
HashiCorp Vault
L4/L7 Load Balancing, TLS/mTLS, NGINX/Envoy
IaC / CI/CD
Terraform
GitHub Actions 또는 GitLab CI
Image Scanning, Canary/Blue-Green Deployment

우대사항
CASB / DLP / WSS 등 Enterprise Security Gateway 경험
Azure AD/Entra ID, Okta, SAML 2.0, OIDC 및 SCIM 경험
AI/LLM Pipeline, Prompt Engineering, PII Anonymization 경험
Azure OpenAI 사용량, Rate Limit 및 Cost Monitoring 경험
API Gateway, Webhook/REST Integration, Rate Limiting, Circuit Breaker 경험
Datadog, Prometheus/Grafana, Azure Monitor 등 Observability 경험
FinOps 및 24/7 Incident Response (SLA/SLO) 경험

채용절차
이력서 검토 → 전화 인터뷰 → 대면 인터뷰

지원 / 문의
※ recruiting@people4nets.com
※ 469-305-2236 (Jaime)


Job Title: Backend Engineer _ AI Gateway
Contract Period: 1 yr. + extension or direct hire opportunity
Working Location:
Englewood Cliffs, NJ (through September 2026) ※
Plano, TX (effective October 2026 onward) ※

※ We are looking for candidates who are willing to relocate to Texas starting in October and are available to work onsite in New Jersey through September.

Work Hours: 9-6 local time
Pay rate: $10,150 / month (Based on experience and qualifications)
Benefits: Medical / Vision / Dental insurance, PTO (eligible after 90 days)
Person in needed: 1

JD Details
We are building an AI Gateway — a high-performance, secure intermediary layer that routes, inspects, and governs all traffic between enterprise clients and LLM/AI service providers. This role requires deep expertise in network programming, async Python, and cloud infrastructure to design and operate a latency-sensitive, policy-driven gateway that handles massive concurrent streaming connections at scale.


What we are looking for
Async Python & Network Programming (3 + yrs) – Strong hands‑on experience with asyncio, aiohttp/anyio, low‑level TCP/UDP sockets, WebSocket & SSE servers, TLS handshake, connection‑pooling, keep‑alive, and zero‑copy buffering.
Streaming & Large‑Payload Handling – Ability to manage chunked transfer, bidirectional streaming, back‑pressure and high‑throughput data paths for real‑time LLM inference.
Protocol Knowledge – Working familiarity with HTTP/2 & HTTP/3 (multiplexing, HPACK), gRPC, and occasional custom protocol parsers.
FastAPI‑Based Backend (3 + yrs) – Design, develop and test production‑grade REST/Streaming APIs; pragmatic use of Pydantic, dependency injection and OpenAPI docs.
Containerization & Kubernetes – Docker, AKS/EKS/GKE deployment experience; HPA/VPA scaling, rolling updates, and service‑mesh (e.g., Istio/Envoy) basics.
Async Messaging & Event‑Driven Design – Production use of Redis Streams, RabbitMQ or Kafka for decoupled task queues, retries and back‑off logic.
PostgreSQL & Vault – Advanced query tuning, partitioning, PgBouncer pooling, plus HashiCorp Vault (dynamic secrets, transit encryption) for key management.
Cloud Networking & Security – L4/L7 load balancing, TLS termination, reverse‑proxy (NGINX/Envoy), mTLS between services, and automated cert lifecycle (ACME/Let’s Encrypt).
IaC & CI/CD – Terraform modules for multi‑env infra, plus GitHub Actions/GitLab CI pipelines with container image scanning and canary/blue‑green deployments.

Work experience desired
Enterprise Security Gateways – Integration with CASB/DLP/WSS or similar edge‑security platforms; centralized logging & audit trails.
IAM & SSO – Configuring Azure AD/Entra ID, Okta, SAML 2.0 or OIDC SSO flows; managing Conditional Access & SCIM provisioning.
AI/LLM Pipelines – Building prompt‑engineering workflows, PII anonymisation, and monitoring Azure OpenAI (or comparable) usage, rate limits & cost.
API‑Gateway Operations – Custom webhook/REST integrations, circuit‑breaker patterns, rate‑limiting, auto‑retry and health‑checking.
Observability & FinOps – End‑to‑end monitoring with Datadog, Prometheus/Grafana or Azure Monitor; proactive cost‑optimisation and 24/7 incident response (SLA/SLO).


※ Hiring Process: Resume screening, phone interview, and onsite interview

※ How to Apply / Inquiries:
Please send your resume to recruiting@people4nets.com
For inquiries, please contact 469-305-2236 (Jaime)
https://www.instagram.com/p4nsolutions/