component-search

# Redpanda Connect Component Search

Help users discover the right Redpanda Connect components for their streaming pipeline needs.

## Objective

Find and recommend the most relevant components that match the user's natural language query.
Provide enough information for users to understand what each component does, how to configure it, and why it matches their needs.

## Prerequisites

This skill requires: `rpk`, `rpk connect`, `python3`.
See the [SETUP](SETUP.md) for installation instructions.

## Component Categories

Redpanda Connect has 8 types of components:
- **inputs** - Read data from sources (Kafka, HTTP, files, databases, etc.)
- **outputs** - Write data to destinations (Kafka, S3, databases, etc.)
- **processors** - Transform, filter, or enrich messages (mapping, filtering, etc.)
- **caches** - Store data for lookups (Redis, in-memory, etc.)
- **rate-limits** - Control throughput (local, Redis-based, etc.)
- **buffers** - Queue messages between pipeline stages
- **metrics** - Export metrics (Prometheus, CloudWatch, etc.)
- **tracers** - Export traces (Jaeger, OTLP, etc.)

## Tools

### Component Discovery

Lists all available components in a category using rpk.

```bash
# Usage:
rpk connect list <category>

# Examples:
rpk connect list inputs
rpk connect list outputs
rpk connect list processors
```
- Categories: inputs, outputs, processors, caches, rate-limits, buffers, metrics, tracers
- Returns list of all component names in that category
- Use this to discover what components exist before searching for specific ones

### Script format-component-fields.sh

Retrieves and formats component configuration schemas.

```bash
# Usage:
./resources/scripts/format-component-fields.sh <category> <component>

# Examples:
./resources/scripts/format-component-fields.sh outputs redis_hash
./resources/scripts/format-component-fields.sh inputs kafka_franz
./resources/scripts/format-component-fields.sh processors mapping
```
- Requires two arguments:
  - category (inputs