-
AI Models & Platforms November 25, 2024Design Patterns in Python for AI and LLM Engineers: A Practical Guide
As AI engineers, crafting clean, efficient, and maintainable code is critical, especially when building complex systems.Design patterns are reusable solutions to common problems in software design....
-
AI Models & Platforms November 20, 2024Autonomous Agents with AgentOps: Observability, Traceability, and Beyond for your AI Application
The growth of autonomous agents by foundation models (FMs) like Large Language Models (LLMs) has reform how we solve complex, multi-step problems. These agents perform tasks ranging...
-
AI Models & Platforms November 14, 2024LLM-as-a-Judge: A Scalable Solution for Evaluating Language Models Using Language Models
The LLM-as-a-Judge framework is a scalable, automated alternative to human evaluations, which are often costly, slow, and limited by the volume of responses they can feasibly...
-
AI Models & Platforms November 6, 2024Microsoft AutoGen: Multi-Agent AI Workflows with Advanced Automation
Microsoft Research introduced AutoGen in September 2023 as an open-source Python framework for building AI agents capable of complex, multi-agent collaboration. AutoGen has already gained traction...
-
AI Models & Platforms October 28, 2024Microsoft’s Inference Framework Brings 1-Bit Large Language Models to Local Devices
On October 17, 2024, Microsoft announced BitNet.cpp, an inference framework designed to run 1-bit quantized Large Language Models (LLMs). BitNet.cpp is a significant progress in Gen...
-
AI Models & Platforms September 13, 2024TensorRT-LLM: A Comprehensive Guide to Optimizing Large Language Model Inference for Maximum Performance
As the demand for large language models (LLMs) continues to rise, ensuring fast, efficient, and scalable inference has become more crucial than ever. NVIDIA’s TensorRT-LLM steps...
-
AI Models & Platforms August 28, 2024Jamba: AI21 Labs’ New Hybrid Transformer-Mamba Language Model
Language models has witnessed rapid advancements, with Transformer-based architectures leading the charge in natural language processing. However, as models scale, the challenges of handling long contexts,...
