Generative AI / ML Content Prompt Engineer/ LLM Engineer

We are a provider of digital transformation and technology consulting services with a portfolio of solutions for both clients who do not yet have Salesforce and large organizations that work on Salesforce and use its extensive capabilities ☁.

We also provide body and team leasing services in IT, providing specialists in various fields.

Model: remote

Employment type: full-time

Responsibilities:

• Design, test, and optimize prompts for generative AI tools (e.g., ChatGPT, Claude, Gemini, LLaMA) to achieve high-quality, reliable outputs

• Apply advanced prompting techniques, including few-shot learning, chain-of-thought reasoning, role-based prompting, and prompt chaining

• Develop and manage system prompts and user prompts, ensuring proper interaction and alignment with intended use cases

• Evaluate LLM outputs for accuracy, consistency, hallucinations, and unsupported claims, with strong attention to detail

• Define, monitor, and refine KPIs for LLM output quality, usability, and reliability

• Optimize prompts with awareness of token usage, cost efficiency, and performance trade-offs

• Conduct iterative experimentation, quality evaluation, and content testing to continuously improve prompt performance

• Break down complex documents into reusable prompt components, templates, and instructions

• Collaborate with subject matter experts (SMEs) to translate business, clinical, or regulatory requirements into effective prompt logic

Requirements:

• Hands-on experience with generative AI tools and prompt design best practices

• Strong understanding of LLM parameters (e.g., temperature, top_p, max_tokens, frequency penalty) and their impact on model behavior

• Knowledge of context window limitations and strategies for effective context management

• Experience with chunking strategies and metadata tagging for content retrieval

• Strong analytical skills, including the ability to identify inconsistencies, missing information, and unsupported claims in AI-generated content

• Experience in structured writing, technical writing, or documentation, preferably within regulated industries (e.g., pharma, biotech, medical devices)

• Comfort reading and interpreting R&D or clinical documentation, with a solid understanding of standard document structures

• Ability to understand complex documentation and transform it into clear, reusable prompt instructions

• Excellent communication skills and ability to work cross-functionally with technical and non-technical stakeholders

• Full professional proficiency in both Polish and English

• Experience in clinical operations or medical writing

Nice to Have:

• Familiarity with CTD structure, CSR guidelines (ICH E3), clinical protocols, and SAP structure

• Basic understanding of Retrieval-Augmented Generation (RAG) pipelines

• Familiarity with Python, JSON, or YAML to collaborate effectively with LLM developers

• General understanding of AI concepts, limitations, and failure modes

• Prior exposure to regulated industries (e.g., healthcare, finance) and compliance-aware prompt design practices

We offer:

• B2B contract,

• Assistance in defining and support in your development path,

• Benefits package,

• Daily support from team leaders,

• Dedicated certification budget,

• Integration trips/events.