AI Infrastructure
MLOps, training pipelines, deployment, and scaling
34 entities indexed
vLLM + NVIDIA
by vLLM Project
vLLM's NVIDIA backend leverages CUDA kernels, FlashAttention-2, and PagedAttention to deliver state-of-the-art throughput for LLM inference on NVIDIA A100, H100, and H200 GPUs. The integration supports tensor and pipeline parallelism across multiple GPUs, FP8/FP16/BF16 quantization, and CUDA graph capture for minimal per-token latency.
NVIDIA RTX 4090
by NVIDIA
NVIDIA's flagship consumer GPU based on Ada Lovelace. Has become popular for local LLM inference and fine-tuning due to its 24GB GDDR6X memory and high performance-per-dollar ratio, enabling on-premise AI workloads without data center costs.
Pinecone Systems
by Pinecone
Pinecone is the leading managed vector database, purpose-built for AI applications requiring similarity search at scale. It powers retrieval-augmented generation, semantic search, and recommendation systems for thousands of enterprises. Pinecone's serverless architecture eliminates infrastructure management while delivering sub-millisecond query performance.
PagerDuty AI
by PagerDuty
PagerDuty AI is an AIOps agent for incident management that automates triage and response. It intelligently groups related alerts to reduce noise, correlates events to identify root causes, and suggests or executes automated remediation runbooks. This helps teams minimize downtime and streamline their on-call processes.
Streaming Responses
by AaaS
This skill involves implementing real-time, token-by-token data delivery from Large Language Models to end-users. It utilizes protocols like Server-Sent Events (SSE) or WebSockets to create interactive and responsive applications, such as chatbots or code assistants, by progressively displaying content as it's generated.
GitLab Duo Agent
by GitLab
GitLab Duo is an AI-powered assistant integrated into the GitLab DevSecOps platform. It enhances developer productivity across the software development lifecycle by offering code suggestions, summarizing issues, explaining vulnerabilities, and generating tests, all within the native GitLab environment.
Basic RAG Pipeline
by AaaS
This script provides a foundational Retrieval-Augmented Generation (RAG) pipeline. It handles core tasks like loading documents, splitting text into chunks, generating embeddings, and indexing them into a vector store. It includes a basic query interface, making it ideal for learning the RAG workflow and prototyping simple applications.
Serverless Model Deploy
by Community
Packages a trained ML model into a serverless function on AWS Lambda, Modal, or Google Cloud Run, handling cold-start optimization, dependency layering, and auto-scaling configuration. Includes health-check endpoints, structured logging, and a GitHub Actions workflow for automated rollout.
Harness AI
by Harness
Harness AI is an intelligent software delivery agent that automates CI/CD pipelines. It leverages machine learning to verify deployments, detect anomalies in real-time, and automate rollback decisions to ensure service health. This helps reduce mean time to recovery (MTTR) and optimize pipeline execution in complex environments.
Model Serving
by AaaS
Deploys and serves language models in production environments with high availability and low latency. Covers framework selection (vLLM, TGI, Triton), batching strategies, GPU memory management, and auto-scaling configurations for different workload profiles.
K8sGPT
by K8sGPT
AI-powered Kubernetes diagnostics agent that scans clusters for issues and provides plain-language explanations with remediation suggestions. Integrates with multiple LLM backends to analyze pod failures, misconfigurations, and performance bottlenecks in real time.
Weaviate
by Weaviate
Weaviate is an open-source vector database designed for AI-native applications. It enables flexible hybrid search, combining vector and keyword methods, and uniquely supports multi-modal data like text, images, and audio. Weaviate offers both self-hosting for maximum control and a managed cloud service for ease of use.
Advanced RAG Pipeline
by AaaS
Production-grade RAG pipeline with hybrid search, reranking, contextual compression, and multi-index routing. Includes query decomposition, metadata filtering, evaluation metrics, and performance monitoring for enterprise deployments.
Together AI
by Together AI
Together AI provides a high-performance cloud inference platform for open-source models, offering one of the fastest and most cost-effective APIs for running models like Llama, Mistral, and DeepSeek. Its Together Inference platform specializes in speculative decoding and model parallelism techniques, and also offers managed fine-tuning and custom model deployment.
NVIDIA V100
by NVIDIA
NVIDIA Volta architecture GPU that introduced Tensor Cores to the data center, providing the first dedicated matrix multiply hardware for AI. Powered the first wave of transformer model training including BERT and GPT-2, and became the dominant AI training platform from 2017–2020.
Weaviate + Cohere
by Weaviate
Weaviate's built-in text2vec-cohere and reranker-cohere modules for zero-ETL vectorization and result reranking within Weaviate clusters. Automatically embeds documents at write time using Cohere Embed v3 and reranks retrieval results without external orchestration code.
Model Quantization
by AaaS
Reduces model size and inference cost by converting weights from higher to lower precision (FP16 to INT8/INT4). Covers GPTQ, AWQ, GGUF, and bitsandbytes quantization methods with quality-preservation techniques that minimize accuracy degradation.
Replicate
by Replicate
Replicate is a cloud platform that makes it trivial to run open-source machine learning models via a simple API with pay-per-second billing. It hosts thousands of community models spanning image generation, video, audio, and language, and allows developers to package and deploy custom models as Cogs without managing any GPU infrastructure.
Model Caching
by AaaS
Implements intelligent caching layers for LLM responses to reduce latency and API costs. Covers semantic caching (matching similar queries), exact-match caching, TTL-based invalidation, and cache warming strategies for predictable workloads.
Rate Limiter Setup
by AaaS
Configures intelligent rate limiting for LLM API proxies with per-user, per-model, and per-endpoint limits. Implements token bucket, sliding window, and adaptive rate limiting algorithms with Redis-backed distributed state and graceful degradation.
Vector DB Migration
by AaaS
Migrates vector data between different vector database providers (Pinecone, Weaviate, Chroma, Qdrant, Milvus). Handles schema mapping, batch transfers, index recreation, metadata preservation, and validation with rollback support.
Oracle AI
by Oracle
Oracle AI provides a suite of generative AI services built into Oracle Cloud Infrastructure (OCI), including the OCI Generative AI Service powered by Cohere and Meta models. Oracle has uniquely integrated AI capabilities directly into its database (Oracle Database 23ai), ERP, and industry cloud offerings, targeting enterprises with existing Oracle relationships.
Vespa + Haystack
by deepset
Haystack DocumentStore integration for Vespa, Yahoo's open-source big-data serving engine. Combines Vespa's multi-stage ranking, approximate nearest neighbor search, and real-time indexing with Haystack's RAG pipeline builder. Supports BM25 + dense hybrid retrieval at web scale.
Distributed Inference
by AaaS
Runs large language model inference across multiple GPUs or nodes using tensor parallelism, pipeline parallelism, or expert parallelism. Covers distributed serving frameworks, inter-node communication, load balancing, and fault tolerance for enterprise-scale deployments.
Zilliz + Apache Spark
by Zilliz
Connector linking Zilliz Cloud (managed Milvus) with Apache Spark for large-scale batch embedding ingestion and vector ETL pipelines. Enables parallel document embedding across Spark executors with direct write to Zilliz collections, supporting data lake to vector store pipelines at petabyte scale.
SambaNova SN40L
by SambaNova
SambaNova's Reconfigurable Dataflow Unit with a three-tier memory hierarchy: on-chip scratchpad, on-package HBM, and off-package DRAM. The unique architecture enables running multiple models simultaneously and excels at efficient mixture-of-experts inference.
Qualcomm Cloud AI 100
by Qualcomm
Qualcomm's data center AI inference accelerator designed for power-efficient deployment. Based on the same AI architecture as Snapdragon, it delivers competitive inference performance with a focus on power efficiency metrics (TOPS/W) for hyperscale deployments.
Tenstorrent Grayskull
by Tenstorrent
Tenstorrent's first commercial AI accelerator co-designed by Jim Keller. Built on a RISC-V Tensix processor architecture with a mesh NoC, enabling programmable AI compute. Notable for its open software stack and developer-friendly approach to hardware AI.
VectraStore
by Vectra Data Solutions
A cloud-native vector database offering ultra-fast similarity search and scalable storage for embeddings.
TuneCraft
by CraftAI Labs
A managed service for fine-tuning large language models with custom datasets, offering seamless integration and optimization.
GPUStream
by StreamCompute
A serverless GPU platform providing on-demand, high-performance computing for AI inference workloads with pay-per-second billing.
VectorFlow DB
by FlowData Solutions
An ultra-fast, cloud-native vector database designed for lightning-speed similarity search and RAG applications.
PromptVerify
by PromptGuard Labs
Specialized tool for evaluating the quality, consistency, and safety of prompts and responses for generative AI models.
OWASP Top 10 for Agentic Applications
by OWASP Foundation
Security standard for AI agent systems (2026).