AI Solutions Architect & Services Owner (f/m/d)
Frankfurt, DE, 60323 München, DE, 80335
As a Solutions Architect (f/m/d), you will be accountable for building, running, and continuously improving the AI services layer delivered in AllianzGI’s GenAI Hub. You will provide hands-on technical leadership for a small squad (approximately 2–4 engineers) without formal people management responsibility and ensure the platform enables teams to consume GenAI capabilities via secure, scalable, and cost-efficient self-service.
This role is based in the GenAI team and is responsible for building and maintaining AI services, working in partnership with the hybrid cloud team.
You will help define and evolve the operating model for GenAI Hub, establish guardrails and “golden paths,” and ensure production-grade standards for security, governance, resilience, and observability covering Agents & AI Apps, LLM Models, Tools & MCPs enabled by the GenAI Hub.
This position will preferably be based in Frankfurt or Munich, but applications from other locations are also welcome.
What you will do
- Own the AI services layer architecture, roadmap and OKRs for the GenAI Hub, including service catalogue, standards, and the operating model (build/run/change)
- Lead automation and enablement efforts of Azure AI services via Terraform, CICD, GitOps embedded into the Hub, enabling repeatable provisioning and self-service workflows for AI services and workloads, e.g. provision of Azure OpenAI, AI search, Foundry projects, resource groups within the GenAI Hub
- Setup up of standard Evals, Policies and Guardrails on Foundry for general and application specific needs
- Model lifecycle management and Information Security Integration
- Design, deploy and operate a companywide AI Gateway via Azure API Management to enable LLM endpoint governance
- Design and evolve LLMOPS capabilities (evaluation, deployment patterns, routing, controlled fine-tuning where applicable, safety, quality and cost controls and guardrails); Includes technical governance of models, tool/MCP servers, agents and official knowledge bases
- Establish robust RAG and context engineering patterns, including secure enterprise data connectivity and standardized knowledge bases, MCP/tool integrations
- Architect and operate Agentic runtime capabilities, including compute for Agents & workflows, Agent tool/MCP setup and access, orchestration, automated guardrails and policies, evaluations, fallback logic, and auditable interactions for enterprise usage
- Research, enable, provision and onboarding of multi-party AI PaaS, SaaS and MCP integrations covering potential vendors like Amazon, Google, Anthropic, OpenAI, Allianz Tech etc.
- Define and implement operational readiness for AI services within GenAI Hub: monitoring, logging, runbooks, automated DR, incident/problem management processes, reliability targets
- Drive security, compliance, and governance-by-design for AI services, including Zero Trust patterns, private connectivity / network isolation requirements, policy-based access controls, lifecycle governance, security and compliance reporting; Additionally technical control and stakeholder alignment with Information Security, Cyber Security, Core Infrastructure, DR, IAM, Legal, Risk and SDLC
- Responsible for managing the audits for AI Services
- Establish AI Security and compliance controls – AI Security posture management via Defender for Cloud, Data Security Posture Management via Purview and Identify and access management via integration with Entra ID, operations of Agents via Agent 365 and Foundry Control plane, model lifecycle management in Foundry; Additionally, integration with other downstream central systems managed by IT Operations, such as SIEM/Sentinel and Qualys; Threat modelling for AI Services
- Enable adoption through documentation, recordings, reference architectures, and advisory support, coordinating evaluation/testing with AI CoE members and onboarding use cases efficiently
What you bring
- University degree or equivalent in Computer Science, Software-Engineering, Cloud Computing, or related fields
- Minimum seven (7) years in software engineering, with deep understanding of Cloud native solutions & Platform engineering and demonstrated ownership of shared services used by multiple teams
- Minimum three (3) years’ experience and understanding of Azure architecture in enterprise environments (landing zones, networking, identity, governance)
- A minimum of three (3) years’ industry experience in ML/LLM Operations
- A minimum of three (3) years’ experience working with agile teams, required
- Experience in delivering automations at scale (Terraform, CI/CD, Model deployments), enabling repeatable provisioning and self-service of templates, services and solutions
- Experience running production services and solutions via monitoring/logging, SRE-style reliability, incident/problem management, runbooks, and on-call readiness
- Experience working with security/compliance stakeholders to implement Zero Trust, private endpoint connectivity, policy-based access, and auditability for AI-related services
- Relevant certifications are a plus (e.g., Azure Solutions Architect Expert, Azure Security Engineer, Terraform)
- Knowledge of Azure landing zones, networking/private connectivity, network segmentation/optimization, identity and access management for agents (Entra ID), security (Defender for Cloud), governance (Policy), monitoring (Azure Monitor/Log Analytics/Sentinel), Azure API Management, Terraform/CI-CD, secrets (Key Vault), and architecture patterns for RAG/agentic runtimes/LLMOPS controls (evals, routing, cost/quality, guardrails)
- Experience working with production-grade vector databases (e.g., Azure AI Search, MongoDB, Cosmos DB, pgvector, Chroma, or Milvus) for efficient storage and retrieval of embeddings
- Ideally experienced with container technologies (Docker, Kubernetes) and Cloud native services in Azure
- Experience with relational databases (e.g., SQL Server, MySQL, PostgreSQL)
- Experience with Agile development and DevOps practices using tools such as Harness, GitHub, JFrog, Jira, and Datadog
- Well-developed interpersonal skills with the ability to interact effectively at all organizational levels, coupled with excellent English communication both written and spoken
- Ability to understand technical problems presented by non-technical users and communicate technical solutions in a clear, non-technical manner
- Ability to translate and drive conceptual ideas to technical requirements for application development
- Proven ability to work collaboratively in a team environment with a strong customer-service focus
- Strong organizational skills to manage time efficiently, prioritize tasks, and meet multiple deadlines
- Drive roadmap, make decisions, and run reliable services in production (incident/problem management) in a data driven way
- Structured problem-solving and pragmatism (balance speed, cost, risk; simplify and standardize)
- Collaboration and influence without authority (work across platforms, data, app teams, and vendors)
What we offer
- We empower our employees by ensuring flexible work arrangements that maintain a balance between performance, productivity, career development and personal priorities (e.g., hybrid model/ flexible working hours)
- Securing your future: Access to company pension/savings plans
- Shared success: Company share purchasing plan
- Support for what matters: Mental health and wellbeing programs
- Investments in your career: Career opportunities within the entire Allianz Group
- Investments in your skills: Comprehensive learning and development offerings, including certifications and professional qualifications
- … and so much more!
About Allianz Global Investors
Allianz Global Investors is a leading active asset manager, managing assets for individuals, families, and institutions worldwide. Our goal is to actively shape the future of investing for all our clients, wherever their location and whatever their objectives.
Allianz Group is one of the most trusted insurance and asset management companies in the world. Caring for our employees, their ambitions, dreams and challenges, is what makes us a unique employer. Together we can build an environment where everyone feels empowered and has the confidence to explore, to grow and to shape a better future for our customers and the world around us.
At Allianz, we stand for unity: we believe that a united world is a more prosperous world, and we are dedicated to consistently advocating equal opportunities for all. And the foundation for this is our inclusive workplace, where people and performance both matter, and nurtures a culture grounded in integrity, fairness, inclusion and trust.
We therefore welcome applications regardless of ethnicity or cultural background, age, gender, nationality, religion, social class, disability or sexual orientation, or any other characteristics protected under applicable local laws and regulations.
If you feel inspired to promote the active asset management experience, this is the place for you. Join our international, technology-enabled, and agile environment. Simply upload your CV in English to apply for this position. If you need support to navigate our websites or at any stage during your application, please send an email with your request to recruiting@allianzgi.com
Join us. Let’s care for tomorrow.
To Recruitment Agencies:
Allianz Global Investors has an in-house recruitment team that sources great candidates directly. Therefore, Allianz Global Investors does not accept unsolicited resumes from agency or search firm recruiters.
When we do work with recruitment agencies, that engagement is formalized by a contract. Fees will only be paid when there is a contract in place.
Without a contract in place, we will not accept invoices on unsolicited resumes, even if the candidate was ultimately employed by Allianz Global Investors.
Finally, please do not contact hiring managers directly.
91854 | Operations | Professional | n.a. | Allianz Global Investors | Full-Time | Permanent