Senior LLM Engineer

Blacksmith Agency is seeking a Senior LLM Engineer to join their remote team. This role is focused on building and shipping internal automation using production LLM and agent systems that real team members will use daily. This is a builder role, not a research position, and you will not be training models.

Blacksmith Agency is a digital growth partner focused on predictable, measurable revenue. They help companies replace fragmented marketing efforts with a disciplined, data-driven system. If you are looking to build a website that supports revenue, marketing channels that work together, and clear answers to growth, this is the place.

Apply now to own and ship Blacksmith's internal automation roadmap.

Company Overview

Blacksmith Agency is a digital growth partner for companies seeking predictable, measurable revenue from their website and marketing channels. They specialize in website strategy, design, and development, SEO, paid media, and analytics, aiming to replace fragmented marketing efforts with a disciplined, data-driven system that supports real business growth.

They work best with teams focused on long-term ROI and are intentionally selective, not built for churn, volume, or vanity metrics. Their core values include strategy before execution, clear ownership, cleaner data, and decisions driven by evidence.

Quick Details

• Salary Range: Not Specified
• Job Type: Full-time
• Experience: 2 Year+
• Qualifications: Not Specified

Key Responsibilities

• Own and ship the internal automation roadmap using production LLM and agent systems.
• Build agents and workflows with tool use and function calling on Anthropic and OpenAI.
• Develop Evals to prove changes made things better and guardrails to prevent wrong or unsafe actions.
• Integrate WordPress, Figma, Google Workspace, Slack, and internal systems.
• Create internal tools to reduce delivery, sales operations, and project management time.

Requirements

• 2+ years building production software in Python or TypeScript / Node.js.
• At least one LLM or agent system built and ran in production with real users.
• Hands-on tool use, evals, and failure handling (validating model output, retries, human approval).
• Experience with REST APIs, webhooks, and cloud deployment.
• Strong spoken English for technical discussions with a US team.

Benefits

• Opportunity to build and ship AI into every part of a company's operations.
• Work on production LLM and agent systems used by real team members daily.
• Contribute to a company focused on predictable, measurable revenue and long-term ROI.
• Remote work opportunity for candidates in Latin America and South Africa.