Jobs
SAP Agent Architect
Parloa
IT
New York, NY, USA
USD 113k-145k / year + Equity
Posted on May 14, 2026
About Parloa
Parloa’s mission is to make every customer conversation feel effortless for both customers and the companies serving them. As agentic AI accelerates, Parloans are shaping the foundation of a new era in customer experience — one where customer support is no longer transactions, but meaningful exchanges. It is not just a vision; Parloa has powered over ONE BILLION interactions between global enterprise brands and their customers, with companies like Booking.com, Allianz, SAP, BarmeniaGothaer and TUI already deploying Parloa at scale.
About the Role:
As a SAP Agent Architect at Parloa, you will help transform customer service with AI agents in enterprise SAP environments. In this customer-facing role, you will support implementations where Parloa’s conversational AI platform must work reliably with SAP data, processes, and integration constraints -from design through testing and go-live readiness.
You combine LLM and agent design (prompt engineering, conversational structure, quality, and operational readiness) with hands-on SAP integration literacy: you understand how Parloa agents should read from and write to SAP systems safely and predictably, and you partner with Forward Deployed Engineering and customer SAP teams to make that path buildable, testable, and production-grade.
You will design, prototype, validate, and refine conversational solutions and agent workflows that depend on SAP-backed use cases (for example order management, customer data, case management, and transactional queries), while ensuring the integration layer between Parloa and SAP is reflected accurately in agent behavior, tools, and guardrails.
Areas of Ownership:
- Scope and implement AI Agent deployments, providing strategic advice and execution support to customers and partners with a focus on programs where SAP-backed systems and processes are in scope (for example SAP Service Cloud / CRM, and related enterprise SAP landscapes)
- Leverage your knowledge of LLMs (e.g., embeddings) to analyze customer requirements and design precise prompts for reliable, user-aligned behavior, including cases where agent actions depend on SAP-sourced data and SAP business rules
- Simplify complex workflows and processes into digestible conversational components, enabling LLMs to handle challenging tasks effectively
- Fine-tune conversational flows and voice output (e.g., SSML, Lexicons, Regex) to align with customer brand standards
- Build and configure integrations between customers’ systems and Parloa’s platform, connecting external tools (e.g., CRMs, ERPs, ticketing systems, contact center platforms, including SAP CX / SAP ERP surfaces where applicable) via integration platforms and APIs to deliver end-to-end enterprise solutions
- Collaborate with Forward Deployed Engineers on complex or custom integration scenarios that go beyond standard integration capabilities, including SAP-specific connectivity, authentication, and data-access patterns (e.g., OData, REST/SOAP, OAuth2 / SAP IAS / XSUAA) where they materially affect agent behavior and reliability
- Identify and solve blockers together with other departments at Parloa (e.g., Product, Forward Deployed Engineering or Sales) and the customer, including coordination with customer SAP teams and SAP partner engineers when required to unblock delivery
- Apply structured testing approaches to validate AI agent behaviour, quality, and performance under real-world conditions — with explicit coverage for integration-dependent paths common in SAP environments (partial responses, authorization failures, latency, and transactional correctness)
- Document best practices, how-to guides, and product capabilities for internal and external audiences, representing the expertise of the Agent Architect team
Who You Are:
- 4+ years in enterprise customer-facing roles with proven expertise in conversation design and AI agent development for implementation settings (not only concept work)
- Exposure to SAP AI Core, SAP Agent Builder, or similar AI extensions within SAP
- Experience with conversational AI / contact center / CX technology in an SAP context
- Demonstrable SAP integration experience in live enterprise delivery contexts, including comfort operating across SAP BTP, S/4HANA, ECC, Service Cloud, CRM, and/or adjacent SAP CX stacks as they relate to agent-connected use cases
- Solid understanding of SAP APIs and data access patterns across one or more relevant surfaces: OData v2/v4, REST/SOAP, and authentication patterns including OAuth2 and SAP IAS/XSUAA
- Strong prompt engineering and LLM workflow design skills: you can analyze requirements and craft prompts/instructions for reliable, user-aligned behavior under enterprise constraints
- Analytical and structured communicator: explicit trade-offs, decisions, next steps; strong stakeholder and milestone discipline
- Proficiency with JSON/XML, API testing tools (e.g. Postman), and reading enterprise API documentation
Nice to Have:
- Experience working with or for SAP system integrators in delivery or presales-adjacent engineering roles
- Familiarity with cloud landing zones commonly paired with SAP integrations (e.g., Microsoft Azure), Kubernetes concepts, and/or TypeScript/Node.js tooling for integration-heavy delivery
- Git-based collaboration and CI/CD exposure
How You Will Work With Parloa Teams:
You will work as a technical delivery partner alongside Forward Deployed Engineering (including SAP integration specialists) on shared technical outcomes: reliable connectivity, correct data contracts, and agent behavior that holds up in production. You are expected to work on integration mechanics where they directly impact agent quality: API contracts, authentication and token flows, request/response shaping, pagination and filtering, error handling, latency and timeouts,, and environment-specific constraints, and to debug, validate, and tighten those paths using structured tests and measurable evidence.
This is not a “design-only” handoff model: you will configure, test, and iterate integration-connected agent capabilities with the same engineering rigor you apply to prompts and conversational structure, escalating to deeper platform engineering when the problem crosses into core product/runtime ownership.
Our Recruiting Process:
Talent Acquisition → Hiring Manager → Technical & Expert Interview(s) → Bar Raiser
Why Parloa?
We’re at the beginning of a new era in customer experience, one where AI doesn’t just respond, but understands, reasons, and takes action. We’re building agentic AI that enterprises trust with their most important customer moments: complex questions, high volumes, real stakes. When millions of people reach out to a brand, those interactions aren’t just support tickets; they’re defining experiences. We’re here to raise the standard: making every conversation seamless, intelligent, and genuinely helpful. If you care about shaping how businesses and customers connect at scale—and want your work to matter in real, everyday moments—this is where you do it.
At Parloa, ownership isn’t a buzzword; it means being accountable for outcomes, not just tasks. We operate in a category that’s evolving fast, where the bar is high, and the problems are complex. We hire people who think in solutions, communicate with clarity, and follow through. People who are comfortable making decisions, taking responsibility, and raising the standard for themselves and those around them.
We’ve grown beyond the earliest startup phase, but we’ve kept the intensity: fast execution, direct feedback, and a strong expectation to contribute meaningfully from day one.
Backed by leading global investors like General Catalyst, EQT Ventures, and Altimeter Capital, we’re scaling with a clear ambition: to become the global category leader in enterprise-grade conversational AI.
Compensation for this role is structured as On-Target Earnings (OTE), consisting of a base salary and performance-based variable component, in addition to an equity package.
Salary Range
$113,000—$145,000 USD
Parloa is committed to upholding the highest data protection standards for our clients' and employees' data. All our employees are instrumental in ensuring the utmost care, GDPR, and ISO compliance, including ISO 27001, in handling sensitive information.
Parloa is an e-verify employer in the USA. Please click here to learn more.
* We provide equal opportunities to all qualified applicants regardless race, gender, sexual orientation, age, religion, national origin, disability status, socioeconomic background and other characteristics.