Note: The job is a remote job and is open to candidates in USA. Accenture Federal Services is dedicated to helping the US federal government enhance its operations and service to the public. They are seeking a Generative AI Platform Engineer to operationalize AI services, implement governance measures, and optimize performance and cost for AI applications in federal programs.
Responsibilities
- Operationalize LLM/RAG: Stand up and harden AI services (cloud or on‑prem) that ground responses in mission data with low hallucination rates
- Guardrails & governance: Implement prompt/version management, policy‑based filtering, role‑based access, audit trails, and safety checks aligned to federal guidelines
- Observability & SRE for AI: Define SLIs/SLOs (quality, latency, safety, cost), instrument metrics, run on‑call, lead postmortems, and reduce MTTR
- Performance & cost engineering: Optimize p95 latency with caching/batching/autoscaling; meter usage and apply FinOps to keep token/spend within targets
- Reusable platform components: Ship SDKs, CI/CD templates, and Terraform/IaC modules that accelerate multiple mission teams not one‑off projects
- Applied theory (where it matters): Use IR metrics (e.g., NDCG) to improve retrieval quality; apply queueing/control principles to hit latency SLOs; run offline/online evals for helpfulness, safety, and factuality
Skills
- Own production systems end‑to‑end: Integration → deployment → observability → incident response
- Are strong in Python
- Have experience with retrieval/vector search (e.g., pgvector/Milvus/OpenSearch) and grounding AI in enterprise data
- Think in SLOs and dashboards; you improve reliability, latency, safety, and cost with data
- Communicate clearly with engineers, PMs, and security stakeholders especially in compliance‑heavy environments
- Must be a US Citizen
- Experience integrating leading cloud AI services or on‑prem inference stacks
- Background in evaluation/safety testing or A/B experimentation for AI experiences
- FinOps for AI: metering, budgets, and optimization strategies for usage and spend
- Prior work in regulated/secure environments (e.g., FedRAMP‑like controls, ATO processes) with fast shipping
- Contributions to internal frameworks or open‑source tooling; mentorship of engineers
- Advanced degree welcome but not required high‑impact delivery matters most
Benefits
- Hands-on experience
- Certifications
- Industry training
- Accenture Federal Services offers a wide variety of benefits. You can find more information on benefits here.
- Accenture Federal Services is committed to providing equal employment opportunities for persons with disabilities or religious observances, including reasonable accommodation when needed.
- Accommodations made to facilitate the recruiting process are not a guarantee of future or continued accommodations once hired.
- If you are hired by Accenture Federal Services and require accommodation to perform the essential functions of your role, you will be asked to participate in our reasonable accommodation process.
Company Overview