Table of Contents Understanding LLM guardrailsHow guardrails workEasily implementing guardrails with QuarkusInput guardrailsOutput guardrailsSanitizing LLM input and output Integrating Large Language Models (LLMs) into our applications is becoming increasingly popular. These models are extremely useful for creating content, searching documentation, …
-
What is RAG, and How to Secure It
Table of Contents Why use RAGHow RAG Works1. Retrieval2. GenerationSecurity implications of using RAGPrompt injection through retrieved contentData poisoningAccess control gaps in retrievalLeaking PII to third-party modelsCaching risks and session bleedContradictory or low-quality informationProactive and remediation strategies for securing RAGSanitize …
-
Building Autopo: An AI-powered Open Source Application to Manage .po Files
As a developer today, you’ve almost certainly encountered the need of localizing your application or website.
-
Building FormPilot: My Journey Creating an AI-Powered Form Filler with RAG, LangChain4j, and Ollama
Table of Contents The InspirationThe ArchitectureGetting Started: Setting Up Your EnvironmentPart 1: Installing and Running Ollama LocallyPart 2: Creating the Spring Boot Project via Spring InitializrImplementing RAG with LangChain4jThe Magic of LangChain4j’s @AiServiceIntegrating with OllamaBuilding the Chrome ExtensionSetting up the …
-
Foojay Webinar Live Stream: Java’s Place in the AI Revolution
Table of Contents GuestsFrank GrecoZoran SevaracModeratorPratik PatelLinksSlides This first online Foojay Webinar highlights Java’s place in the AI revolution, focusing on exploring AI/ML using pure Java tools. AI and Machine Learning (ML) are becoming essential in modern software development. For …
-
SummarizingTokenWindowChatMemory: Enhancing LLM’s Conversations with Efficient Summarization
Table of Contents SummarizingTokenWindowChatMemoryThe Summarizer InterfaceSummarization LogicLLM SummarizationWhy This MattersConclusion LLM chat models have become an integral part of many applications today. We are all experimenting and exploring the best ways to utilize them effectively. For Java developers, LangChain4j has …
-
Building local LLM AI-Powered Applications with Quarkus, Ollama and Testcontainers
Table of Contents Project Overview1. Integrating Quarkus with OllamaWhy Ollama?Quarkus and Ollama Integration2. Using Testcontainers for Integration TestingWhy Testcontainers?Example: Setting up a Testcontainer for OllamaKey Points:3. Leveraging Quarkus Dev Services for OllamaWhat Are Quarkus Dev Services?Configuring Dev ServicesDevelopment WorkflowConclusionKey Takeaways: …