RL-A2A.github

# 🤖 RL-A2A Enhanced: Secure Multi-AI Agent Communication System [](#security) [](#ai-providers) [](#changelog)    An enhanced, secure Agent-to-Agent (A2A) communication system with reinforcement learning, multi-AI provider support, real-time 3D visualization, and comprehensive security features. ## 📺 Project Overview & Objectives RL-A2A Enhanced democratizes multi-agent system development by providing a comprehensive, production-ready platform that bridges research and real-world applications. Enhanced with enterprise-grade security, multi-AI provider support, and advanced monitoring capabilities. **Core Objectives:** - Simplify multi-agent system creation with security-first approach - Provide real-time agent communication via secure WebSocket architecture - Integrate multi-AI provider decision making (OpenAI, Claude, Gemini) - Deliver comprehensive visualization and security monitoring - Enable seamless integration with AI assistants through enhanced MCP support   ### 🔒 **Security Enhancements** - **Data Poisoning Protection**: Input validation, sanitization, and size limits - **JWT Authentication**: Secure token-based authentication system - **Rate Limiting**: Configurable rate limiting on all endpoints - **CORS Security**: Configurable allowed origins and trusted hosts - **Session Management**: Secure session handling with automatic cleanup ### 🤖 **Multi-AI Provider Support** - **OpenAI**: GPT-4o-mini integration with timeout protection - **Anthropic**: Claude 3.5 Sonnet support with rate limiting - **Google**: Gemini 1.5 Flash integration with error handling - **Fallback System**: Graceful degradation when providers fail ### 📊 **Enhanced Visualization & Monitoring** - **Real-time 3D Environment**: Interactive agent positioning and tracking - **Security Dashboard**: Real-time security metrics and alerts - **Analytics Dashboard**: Comprehensive performance tracking - **Multi-dimensional Analysis**: Emotion, action, reward, and velocity visualization ## ✨ Enhanced Features - 🤖 **Multi-Agent Communication** - Secure WebSocket-based real-time coordination - 🧠 **Multi-AI Integration** - OpenAI, Claude & Gemini powered intelligent decision making - 🎨 **Enhanced 3D Visualization** - Interactive Plotly dashboards with security monitoring - 📈 **Advanced Reinforcement Learning** - Q-learning with adaptive feedback and validation - 🔒 **Enterprise Security** - JWT authentication, rate limiting, data validation - 🔌 **Enhanced MCP Support** - Secure Model Context Protocol for AI assistants - ⚡ **Production Architecture** - Dual approach with Docker support and auto-configuration - 🗺️ **Environment Management** - Comprehensive .env configuration with security defaults ## 🚀 Enhanced Quick Start ### 1. Enhanced Installation ```bash # Clone the repository git clone https://github.com/KunjShah01/RL-A2A.git cd RL-A2A # Switch to enhanced branch (for latest security features) git checkout security-fixes-and-enhancements # Install enhanced dependencies with security packages pip install -r requirements.txt # Setup enhanced environment with security defaults python rla2a_enhanced.py setup ``` ### 2. Enhanced Configuration Edit `.env` with your API keys and security configuration: ```bash # Multi-AI Provider API Keys OPENAI_API_KEY=your-openai-api-key-here ANTHROPIC_API_KEY=your-anthropic-api-key-here GOOGLE_API_KEY=your-google-api-key-here # Enhanced Security Configuration SECRET_KEY=your-secret-key-for-jwt-signing ALLOWED_ORIGINS=http://localhost:3000,http://localhost:8501 RATE_LIMIT_PER_MINUTE=60 # System Configuration DEFAULT_AI_PROVIDER=openai MAX_AGENTS=100 DEBUG=false ``` ### 3. Enhanced System Execution **Start the Enhanced A2A Server with Security:** ```bash python rla2a_enhanced.py server --demo-agents 3 ``` **Start the Enhanced Dashboard with Security Monitoring:** ```bash python rla2a_enhanced.py dashboard ``` **Access Enhanced Features:** - 🌐 **Enhanced Dashboard**: http://localhost:8501 (with security monitoring) - 🔗 **Secure API Documentation**: http://localhost:8000/docs - 📡 **Secure WebSocket**: ws://localhost:8000/ws/{session_id} --- ## 📁 Enhanced Repository Structure ``` RL-A2A/ ├── rla2a.py # Original system (deprecated in favor of enhanced) ├── a2a_server.py # Modular: FastAPI server with RL ├── agent_a.py # Modular: Example agent implementation ├── .env # Enhanced environment configuration template ├── requirements.txt # Enhanced dependencies with security packages ├── SECURITY.md # Comprehensive security documentation ├── MIGRATION.md # Migration guide from original to enhanced ├── docs/DEPLOYMENT.md # Production deployment guide ├── MCP_GUIDE.md # Enhanced MCP integration guide └── README.md # This enhanced overview ``` ## 🚀 Updated Quick Start (Combined System) ### 1. Clone and Setup ```bash git clone https://github.com/KunjShah01/RL-A2A.git cd RL-A2A git checkout enhanced-integration # Setup environment (installs dependencies automatically) python rla2a.py setup ``` ### 2. Configure API Keys Edit `.env` file with your API keys: ```bash OPENAI_API_KEY=your-openai-key ANTHROPIC_API_KEY=your-claude-key GOOGLE_API_KEY=your-gemini-key ``` ### 3. Start the System ```bash # Start server with 5 demo agents python rla2a.py server --demo-agents 5 # In another terminal, start the dashboard python rla2a.py dashboard ``` ### 4. Access the System - 🌐 **Dashboard**: http://localhost:8501 - 📄 **API Docs**: http://localhost:8000/docs - 📊 **System Report**: `python rla2a.py report` **That's it! The combined system includes everything! 🎉** --- ## 📊 System Comparison | Feature | Original | Enhanced Branch | **Combined rla2a.py** | |---------|----------|-----------------|----------------------| | Agent Communication | ✅ | ✅ | ✅ | | OpenAI Integration | ✅ | ✅ | ✅ | | Multi-AI Providers | ❌ | ✅ | ✅ | | Enhanced Security | ❌ | ✅ | ✅ | | Smart Dependencies | ❌ | ❌ | ✅ | | 3D Visualization | ✅ | ✅ | ✅ | | Auto Setup | ✅ | ❌ | ✅ | | Production Ready | ❌ | ✅ | ✅ | | One File Solution | ✅ | ❌ | ✅ | **🏆 Winner: Combined `rla2a.py` - Best of both worlds!** --- ## 🗺️ Complete System Architecture & Usage Guide ### 🏢 Architecture Options  #### 🔧 All-in-One (`rla2a.py`) - *Recommended for Beginners* - ✅ **Setup**: One command installation and auto-dependency management - ✅ **Development**: Everything in one place with smart fallbacks - ✅ **Production**: Self-contained deployment with security features - ✅ **Learning**: Complete system overview with enhanced docs - ✅ **Multi-AI**: OpenAI, Claude, Gemini support built-in #### ⚡ Modular (`a2a_server.py` + `agent_a.py`) - *Recommended for Development* - ✅ **Setup**: Manual dependency management for fine control - ✅ **Development**: Easy to extend individual components - ✅ **Production**: Scalable microservice architecture - ✅ **Learning**: Clear separation of concerns - ✅ **Deployment**: Docker/container friendly - ✅ **Customization**: Create new agent files easily ### 🎮 Enhanced Command Options #### All-in-One Combined System Commands ```bash # Complete system with demo agents (with multi-AI support) python rla2a.py server --demo-agents 5 # Enhanced interactive dashboard with security monitoring python rla2a.py dashboard # MCP server for AI assistant integration python rla2a.py mcp # Generate comprehensive HTML system report python rla2a.py report # Smart environment setup with dependency management python rla2a.py setup # Show detailed system information and capabilities python rla2a.py info ``` #### Modular System Commands ```bash # Advanced server options python a2a_server.py # Default: localhost:8000 uvicorn a2a_server:app --host 0.0.0.0 # Public access # Multiple agents python agent_a.py & # Background agent python agent_a.py # Another agent # Custom agent development cp agent_a.py my_custom_agent.py # Edit my_custom_agent.py for custom behavior ``` ## 🧮 Multi-AI Intelligence Configure multiple AI providers in your `.env` file: ```bash # Multi-AI Provider Configuration OPENAI_API_KEY=sk-your-openai-key-here ANTHROPIC_API_KEY=sk-ant-your-claude-key GOOGLE_API_KEY=your-gemini-api-key # Choose default provider DEFAULT_AI_PROVIDER=openai # or anthropic, google ``` **Enhanced AI Capabilities:** - 🧪 **OpenAI GPT-4o-mini**: Fast, efficient general intelligence - 🤖 **Anthropic Claude**: Advanced reasoning and safety - 🔍 **Google Gemini**: Multimodal AI with broad knowledge - 🔄 **Automatic Fallback**: Switches providers if one fails - 📊 **Performance Tracking**: Monitor success rates and usage - 🔒 **Secure Authentication**: JWT tokens and rate limiting ## 🎨 Enhanced Visualization Dashboard Interactive Streamlit dashboard featuring: - **🌐 Real-time 3D Agent Tracking** - Live positions with emotion-based colors - **📊 AI Provider Status** - Monitor OpenAI, Claude, and Gemini performance - **📈 Performance Metrics** - Rewards, emotions, activity analysis - **⚙️ Agent Management** - Register agents, send feedback, control system - **📈 Live Analytics** - Auto-refresh charts and system health - **💾 Data Export** - Download agent data as CSV format - **🔒 Security Monitoring** - Real-time security status and alerts - **🖥️ Multi-dimensional Analysis** - Emotion, action, reward visualization  *Real-time visualization of multi-agent performance and learning progress* ## 🔌 Enhanced MCP Integration Control the system via AI assistants (Claude, ChatGPT, etc.): ```bash python rla2a.py mcp # Start enhanced MCP server ``` **Natural language commands:** - "Start the RL-A2A system with 5 agents using Claude AI" - "Create a new agent called explorer with OpenAI provider" - "Show me comprehensive system status and security metrics" - "Generate a performance report for all active agents" - "Switch all agents to use Gemini AI provider" 📈 **Detailed guide**: [MCP_GUIDE.md](MCP_GUIDE.md) ## 📄 Comprehensive API Reference ### Core API Endpoints | Endpoint | Method | Description | Enhanced Features | |----------|--------|-------------|-------------------| | `/` | GET | System status | Multi-AI provider info | | `/health` | GET | Health check | Security metrics | | `/register` | POST | Register agent | Enhanced validation | | `/agents` | GET | List all agents | Comprehensive stats | | `/feedback` | POST | Send RL feedback | Advanced Q-learning | | `/stats` | GET | System statistics | AI provider analytics | | `/ws/{session_id}` | WebSocket | Real-time communication | Security validation | ### Enhanced Security Features - 🔒 **JWT Authentication**: Secure token-based access - 🚫 **Rate Limiting**: Configurable request throttling - 🛡️ **Input Validation**: Sanitization and size limits - 🌐 **CORS Protection**: Configurable origin restrictions - 🔑 **Session Management**: Automatic timeout and cleanup ## 🐳 Production Deployment ### Docker Deployment **All-in-One Container:** ```dockerfile FROM python:3.11-slim COPY . /app WORKDIR /app RUN pip install -r requirements.txt EXPOSE 8000 8501 CMD ["python", "rla2a.py", "server", "--demo-agents", "3"] ``` **Multi-Container Setup:** ```yaml # docker-compose.yml version: '3.8' services: a2a-server: build: . command: python a2a_server.py ports: ["8000:8000"] environment: - OPENAI_API_KEY=${OPENAI_API_KEY} - ANTHROPIC_API_KEY=${ANTHROPIC_API_KEY} agent: build: . command: python agent_a.py depends_on: [a2a-server] ``` ### Production Environment Configuration ```bash # Production .env settings DEBUG=false LOG_LEVEL=WARNING A2A_HOST=0.0.0.0 MAX_AGENTS=200 RATE_LIMIT_PER_MINUTE=120 # Security SECRET_KEY=your-production-secret-key ALLOWED_ORIGINS=https://yourdomain.com ENABLE_SECURITY=true ``` ## 🔧 Development Guide ### Creating Custom Agents **Modular Approach** (recommended for development): ```python # Custom agent with enhanced AI providers import agent_a class MyEnhancedAgent(agent_a.AgentClient): def __init__(self, agent_id: str, ai_provider: str = "claude"): super().__init__(agent_id) self.ai_provider = ai_provider def execute_action(self, action_command: str) -> float: # Custom action logic with multi-AI support return super().execute_action(action_command) ``` **Combined System Approach:** ```python # Extend the combined enhanced system class CustomA2ASystem(A2ASystem): async def get_ai_response(self, prompt: str, provider: str = "openai"): # Custom AI logic with enhanced security return await super().get_ai_response(prompt, provider) ``` ## 🏅 What Makes RL-A2A Enhanced Special? ✅ **Combined Architecture** - Best of all-in-one and modular approaches ✅ **Multi-AI Intelligence** - OpenAI, Claude, Gemini with automatic fallback ✅ **Enterprise Security** - JWT, rate limiting, input validation, CORS protection ✅ **Production Ready** - Comprehensive logging, monitoring, error handling ✅ **Smart Dependencies** - Automatic installation with graceful fallbacks ✅ **Educational Excellence** - Learn from clean, well-documented code ✅ **Highly Extensible** - Add custom agents, AI providers, and features ✅ **Real-time Visualization** - Beautiful 3D dashboards and analytics ✅ **Industry Standards** - MCP support for AI ecosystem integration ✅ **One File Solution** - Deploy anywhere with single file containing everything ## 🤝 Contributing 1. **Fork** the repository 2. **Choose approach**: Enhanced combined system or modular components 3. **Test thoroughly**: Verify both security and functionality 4. **Update documentation**: Keep README and guides current 5. **Submit PR**: Include comprehensive test instructions ### Development Setup ```bash # Clone for development git clone https://github.com/KunjShah01/RL-A2A.git cd RL-A2A git checkout enhanced-integration # Setup development environment python rla2a.py setup # Test the combined system python rla2a.py server --demo-agents 3 python rla2a.py dashboard python rla2a.py report ``` ## 📝 License MIT License - see [LICENSE](LICENSE) file for details ## 🆘 Support & Community - 🐛 **Issues**: [GitHub Issues](https://github.com/KunjShah01/RL-A2A/issues) - 💬 **Discussions**: [GitHub Discussions](https://github.com/KunjShah01/RL-A2A/discussions) - 📧 **Contact**: [Kunj Shah](https://github.com/KunjShah01) - 📈 **Detailed Documentation**: Check out all `.md` files in the repository - 🛠️ **System Reports**: Generate with `python rla2a.py report` --- **⭐ If this enhanced multi-agent system helps you build amazing AI applications, please give it a star! Your support drives continued development.** **🎉 Happy Enhanced Agent Building with RL-A2A! 🚀** - 🛠️ **System Reports**: Generate with `python rla2a.py report` --- **⭐ If this enhanced multi-agent system helps you build amazing AI applications, please give it a star! Your support helps drive continued development and improvements.** **🎉 Happy Agent Building with RL-A2A Enhanced! 🚀** print(performance) if __name__ == "__main__": asyncio.run(main()) ``` ### Multi-Agent Interaction ```python import asyncio from agent_client import AgentClient async def run_agents(): # Create multiple agents agent1 = AgentClient("Agent1", "localhost:8000") agent2 = AgentClient("Agent2", "localhost:8000") # Run agents concurrently await asyncio.gather( agent1.run(iterations=5), agent2.run(iterations=5) ) if __name__ == "__main__": asyncio.run(run_agents()) ``` ## Directory Structure ``` . ├── a2a_server.py # The FastAPI-based communication server with agent RL logic ├── agent_a.py # Example implementation of an autonomous agent ├── README.md # This documentation file ├── requirements.txt # Project dependencies ├── docs/ # Additional documentation │ ├── api/ # Detailed API documentation │ ├── examples/ # Example code and tutorials │ └── assets/ # Images and other assets ├── tests/ # Test cases └── examples/ # Additional example implementations ``` ## Contributing Contributions are welcome! Please follow these steps to contribute: 1. Fork the repository and clone your fork 2. Create a new branch for your feature or bugfix 3. Add your implementation (e.g., new agent, protocol improvement, architecture demo) 4. Update documentation as needed 5. Submit a pull request describing your changes ### Contribution Guidelines - Follow PEP 8 style guidelines for Python code - Include docstrings for all functions, classes, and modules - Write unit tests for new functionality - Update documentation to reflect changes - Keep pull requests focused on a single change ## Future Roadmap ### Version 0.2.0 (Q3 2025) - **Expand Agent Architectures:** Add more agent types (belief-desire-intention, multi-agent coordination, etc.) - **Advanced Reinforcement Learning:** Support for deep RL (DQN, PPO) and more sophisticated reward strategies - **Multiple Agent Demos:** Simulate multi-agent environments with competitive/cooperative scenarios ### Version 0.3.0 (Q4 2025) - **Visualization:** Real-time dashboards for monitoring agent interactions and learning - **Extensible Protocol:** Support for encrypted messages, agent authentication, and richer agent metadata - **Documentation Expansion:** Full API docs, example notebooks, and tutorials ### Version 1.0.0 (Q1 2026) - **Benchmarking:** Performance and scalability metrics for agent communication - **Testing Framework:** Automated tests for server and agent logic - **Production Readiness:** Stability improvements and performance optimizations ### Long-term Vision - **Cloud Deployment:** Managed service for A2A protocol - **Language Agnostic:** Support for multiple programming languages - **Integration Ecosystem:** Connectors for popular AI and ML frameworks ## Changelog ### v0.1.0 (Current) - Initial release with basic A2A protocol implementation - FastAPI-based server with WebSocket support - Example agent implementation - Simple Q-learning reinforcement learning ## License This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details. ## References - [FastAPI Documentation](https://fastapi.tiangolo.com/) - [MessagePack](https://msgpack.org/) - [Reinforcement Learning (Q-learning)](https://en.wikipedia.org/wiki/Q-learning) - [WebSockets](https://developer.mozilla.org/en-US/docs/Web/API/WebSockets_API) - [Autonomous Agents](https://en.wikipedia.org/wiki/Intelligent_agent) ## Contact For questions, suggestions, or collaboration, feel free to: - Open an [issue](https://github.com/KunjShah01/AGENT-TO-AGENT-PROTOCOL-/issues) - Submit a [pull request](https://github.com/KunjShah01/AGENT-TO-AGENT-PROTOCOL-/pulls) - Contact the maintainer: [Kunj Shah](https://github.com/KunjShah01)