May 12, 2025
Phase 2 Labs

In a recent analysis by Alan Ramirez, Phase 2 Labs explored how organizations can reduce the operational costs of Large Language Models (LLMs) by implementing context caching—a method that stores and reuses the static parts of AI prompts. This strategy minimizes redundant processing, leading to significant cost savings. Common Business Pain Point: “Our AI tools are powerful, but the cost of running them is escalating quickly—especially as usage grows across departments.” What the Team Learned: Understanding Context Caching: By separating static (unchanging) and dynamic...

BY
1
April 28, 2025
Engineering, Phase 2 Labs

In today's AI-driven landscape, creating systems with long-term memory capabilities has become increasingly important. Whether you're building a customer service chatbot that remembers interactions with its users and maintaining history longer than the context window are crucial parts of a successful system. While there are many components that go into building a fully functional long-term memory solution, Zep can be a powerful tool to help developers implement long-term memory in their AI applications. What is Zep? Zep is an API-based solution that...

BY
1
April 28, 2025
Engineering, Phase 2 Labs

Introduction Large Language Models (LLMs) have revolutionized how organizations process and generate natural language content, but their operational costs can become significant at scale. One of the most effective techniques for reducing these costs is context caching, which allows reuse of static prompt components across multiple requests. This article examines how the three major AI providers—Google (Gemini), Anthropic (Claude), and OpenAI—implement context caching, with detailed analysis of their technical approaches, pricing structures, and practical limitations. The Technical Fundamentals of Context Caching When interacting...

BY
2
April 28, 2025
Engineering, Phase 2 Labs

Unless you've recently spent your free time nose-deep in GitHub repos or interrogating ChatGPT like it's a barista who got your coffee order wrong, you may not be familiar with MCP servers. That’s okay. Two weeks ago, I wasn’t either. But thanks to a casual, "Hey, can you connect Notion to our project via an MCP server?" from a teammate (and my relentless need to avoid looking clueless), I dove headfirst into the rabbit hole. What I discovered is something potentially...

BY
9
April 8, 2025
Engineering, Phase 2 Labs

Imagine you’re an inventory manager for a retail business and you need to quickly verify stock levels for an unexpected large order while away from your computer. Instead of logging into a dashboard, navigating through menus, and analyzing spreadsheets, you simply send a text message: "Do we have enough iPhones to fulfill an order for 100 units?" Within seconds, you receive a reply: "You have 157 iPhones currently in stock, so you can fulfill this order. Based on your current sales rate of...

BY
2