Software Engineer - LLM & Automation

Job Description:• About Basis: Basis is a nonprofit applied AI research organization with two mutually reinforcing goals. • Understand and build intelligence: Establish the mathematical principles of reasoning, learning, decision-making, understanding, and constructing software that embodies these principles. • Advance society’s ability to solve intractable problems: Expanding the scale, complexity, and breadth of problems we can solve today and accelerating our ability to solve problems in the future.• Building scalable systems that integrate large language models (LLMs) with operational workflows. • Designing and deploying automated “pipelines” for tasks like recruiting, finance, and project management—often powered by LLMs. • Hiring contractors, part-time, or full-time teammates. Requirements:• Have experience programming in Julia and/or Python (3+ years of production-level coding, or equivalent)• Understand how to integrate LLMs using structured prompts, scaffolding frameworks (LangChain-like), or advanced text generation approaches• Can handle concurrency, scaling, and performance optimizations in real-world deployments• Are comfortable with complex API orchestration: dealing with rate limits, OAuth, error retries, etc.• Have good collaboration and communication skills, especially when gathering requirements from non-technical staff• Are flexible and creative problem solvers, comfortable with iterative, experimental development cycles• Embrace data-security best practices (e.g., handling PII, encryption, secrets management)• Are excited to learn quickly and adapt to new developments in the LLM/AI ecosystem• Preferred (not all required):• Julia: Type-driven or multiple-dispatch approaches; performance tuning, HPC, or scientific computing workflows• Python: Building microservices with FastAPI, Flask, or other frameworks; advanced concurrency (async, multiprocessing)• LLM Tools & Frameworks: Familiarity with LangChain, open source LLM clients, or custom chain-of-thought integrations• Cloud Infrastructure: Docker/Kubernetes, bolthires/CD pipelines, AWS/GCP/Azure deployment patterns• Distributed Systems & Queues: Experience with concurrent processing, task queues (Celery, Sidekiq), or event-driven systems• Database Interaction: Ability to design schemas and queries in PostgreSQL or similar databases• Security & Privacy: Understanding of OAuth flows, secrets management, data encryption, and role-based access controlsBenefits: Apply tot his job