Vehicle Detection and Analysis System

Project Overview

This project implements an AI-powered vehicle detection and analysis system using YOLO-based object tracking and Google’s Gemini AI for extracting vehicle details. It processes video footage to detect and track vehicles, identifies number plates, and classifies vehicle attributes such as type, color, and manufacturer.

Key Features

• Real-time Vehicle Detection: Uses YOLO object detection to track vehicles in a defined Region of Interest (ROI).
• AI-based Vehicle Analysis: Google Gemini AI extracts the number plate, vehicle type, color, and manufacturer from cropped vehicle images.
• Multi-threaded Processing: Ensures efficient handling of multiple vehicles simultaneously.
• Data Logging: Saves extracted vehicle details with timestamps in a structured text file.
• Polygonal ROI Selection: Allows vehicle detection within a specific area for focused monitoring.
• Interactive UI: Displays detected vehicles, track IDs, and classification in an OpenCV-based GUI.

Use Cases

• Traffic Monitoring: Enhances smart surveillance for law enforcement and city management.
• Parking Management: Helps in automated parking systems by tracking vehicle entries and exits.
• Toll Booth Automation: Assists in automatic vehicle classification and toll collection.
• Vehicle Access Control: Can be used in secured areas to monitor authorized vehicle access.

Technologies Used

• Python: Core programming language.
• OpenCV: Image processing and real-time visualization.
• Ultralytics YOLO: Object detection and vehicle tracking.
• LangChain & Google Gemini AI: Image-based AI analysis for extracting vehicle attributes.
• cvzone: Enhanced visualization and annotation.
• NumPy: Efficient numerical computations.
• Threading: For concurrent processing of multiple vehicle detections.

Conclusion

The Vehicle Detection and Analysis System integrates AI-powered image processing with real-time object tracking to enhance vehicle monitoring. By combining YOLO-based detection with Gemini AI’s analysis, it enables automated extraction of essential vehicle details, making it suitable for smart traffic management, security, and automation applications.