Multisite RSS Aggregator

Aggregate and Unify Content Across Your WordPress Network

Overview

Multisite RSS Aggregator is an enterprise-grade WordPress plugin that creates unified RSS feeds by aggregating content from all subdomains in a WordPress multisite network. Designed for large-scale deployments up to 800+ subdomains, this plugin transforms your distributed content into centralized, filterable feeds with advanced performance optimization and modern API support.

Version: 2.0.0
Author: Brian Winum
Website: brianwinum.com
License: GPLv2 or later
Network: Yes (Multisite Required)

Why Multisite RSS Aggregator?

As organizations expand their digital presence across multiple subdomains, managing and distributing content becomes increasingly complex. Multisite RSS Aggregator solves this by:

  • Creating unified content streams from hundreds of subdomains
  • Enabling cross-network content discovery and syndication
  • Providing REST API endpoints for modern applications
  • Optimizing performance for enterprise-scale networks
  • Supporting advanced filtering and categorization

Key Features

🚀 Enterprise-Scale Performance

  • Queue-based processing handles 800+ subdomains efficiently
  • Background processing prevents PHP timeouts
  • Intelligent caching with configurable duration
  • Batch processing (5-10 sites at a time) for optimal resource usage
  • Automatic retry logic for failed feed fetches

📊 Advanced Content Filtering

  • Category-based filtering across entire network
  • Tag-based content aggregation
  • Custom post type support (events, products, courses)
  • Multi-criteria filtering in shortcodes and widgets
  • Source site inclusion/exclusion controls

🔌 REST API Integration

  • Modern JSON endpoints at /wp-json/msra/v1/
  • Get aggregated posts with full filtering support
  • Retrieve participating sites information
  • Parameters: limit, order, categories, tags, post_type, sources
  • Perfect for headless WordPress, mobile apps, and external integrations

🎨 Flexible Display Options

  • Powerful Shortcode System: [multisite-rss-feed] with 12+ parameters
  • Drag-and-Drop Widget: Visual configuration interface
  • Multiple Templates: List and grid layouts
  • Featured Image Support: Display post thumbnails
  • Custom Styling: CSS classes for theme integration

🌐 Complete Multisite Architecture

  • Network Admin Dashboard: Centralized control panel
  • Per-Site Controls: Individual sites can opt-in/out
  • Queue Status Monitor: Real-time processing visibility
  • Automatic Site Detection: New subdomains automatically discovered
  • Scalable Database Design: Optimized for large networks

⚙️ Intelligent Queue System

  • Processes sites in configurable batches
  • Prevents memory overload with switch_to_blog() optimization
  • 3-attempt retry system for failed feeds
  • Status tracking: pending, processing, completed, failed
  • 5-minute processing intervals for smooth operation

📰 Traditional RSS Feed Support

  • Custom Feed Endpoints: /feed/multisite/ and /feed/multisite-random/
  • Standard RSS 2.0 compliance
  • Source attribution for each item
  • Featured image support in feeds
  • Proper caching headers

🛡️ Security & Permissions

  • Network admin controls for global settings
  • Site admin controls for local opt-in/out
  • Capability-based permission system
  • Data sanitization throughout
  • Nonce verification on all forms

Technical Specifications

System Requirements

  • WordPress Multisite with subdomain configuration
  • WordPress 5.0 or higher
  • PHP 7.4 or higher
  • MySQL 5.6 or higher
  • 256MB+ PHP memory limit (for large networks)

Performance Optimizations

  • Dual Database Tables: Separate tables for content and queue management
  • Indexed Fields: Optimized queries on key columns
  • Transient Caching: WordPress native caching system
  • Chunked Processing: Memory-efficient content handling
  • Background Tasks: Non-blocking updates via WP Cron

Scale Considerations

  • Small Networks (5-20 sites): Standard settings work perfectly
  • Medium Networks (20-50 sites): Minor batch size adjustments
  • Large Networks (50-200 sites): Queue system becomes essential
  • Enterprise Networks (200-800+ sites): Full optimization features critical

Database Architecture

Main Aggregation Table (multisite_rss_aggregator_items):

  • Stores aggregated content with full metadata
  • Indexes on source_blog_id, published_date, post_type
  • Automatic 30-day content cleanup

Queue Management Table (multisite_rss_aggregator_queue):

  • Tracks processing status for each subdomain
  • Enables fault-tolerant batch processing
  • Maintains retry attempts and failure logs

File Locations

The plugin creates accessible endpoints at:

RSS Feed URLs:

REST API Endpoints:

Admin Interfaces:

  • Network Admin → RSS Aggregator – Global settings
  • Network Admin → RSS Aggregator → Queue Status – Processing monitor
  • Site Admin → RSS Aggregator – Individual site settings

Installation

Network Installation:

  • Upload the multisite-rss-aggregator-pro folder to /wp-content/plugins/
  • Network Activate from Network Admin → Plugins
  • Navigate to Network Admin → RSS Aggregator for initial setup
  • Visit Settings → Permalinks and save to activate feed endpoints
  • Configure global settings and batch processing parameters
  • Queue all feeds for initial population

Post-Installation:

  • Monitor Queue Status page during initial sync
  • Adjust batch size based on server performance
  • Configure cache duration for your update frequency
  • Set up desired display methods (shortcodes/widgets)

Configuration Options

Global Network Settings

  • Default Ordering: Recent or Random
  • Cache Duration: 30-3600 minutes
  • Items per Feed: Number shown in RSS feeds
  • Posts per Site: How many posts to collect per subdomain
  • Batch Size: Sites processed per queue run (5-10 recommended)
  • Post Types: Comma-separated list (post,page,event,product)

Subdomain Management

  • Enable/disable specific subdomains
  • Monitor last update timestamps
  • View individual site status
  • Bulk selection tools for large networks

Display Configuration

  • Shortcode parameters for fine-tuned control
  • Widget settings per instance
  • Template selection (list/grid)
  • Metadata display options

Queue Configuration

  • Processing frequency (5-minute intervals)
  • Retry attempts (default: 3)
  • Batch size optimization
  • Failed feed handling

Use Cases

Multisite RSS Aggregator excels in:

  • University Networks aggregating department news and research
  • News Organizations combining regional bureau content
  • Corporate Intranets unifying divisional updates
  • Franchise Networks sharing location-specific content
  • E-learning Platforms aggregating course announcements
  • Government Portals combining agency information
  • Healthcare Systems unifying facility news
  • Real Estate Networks aggregating property listings

Frequently Asked Questions

Q: Can this handle our 500+ subdomain network?

A: Absolutely! The queue-based architecture is specifically designed for large networks. Set your batch size to 10 sites and let the background processor handle the rest. Networks with 800+ subdomains run smoothly with proper configuration.

Q: How do I filter content by category across all sites?

A: Use the categories parameter: [multisite-rss-feed categories=”news,updates” limit=”50″]. The plugin intelligently queries all network sites for matching categories.

Q: Can sites have different custom post types?

A: Yes! The plugin aggregates any post types you specify. If Site A has “events” and Site B has “products”, both can be included by setting post_types=”post,page,event,product” in settings.

Q: How long does initial synchronization take?

A: For a 100-site network with 20 posts per site, expect 30-60 minutes for complete initial sync. The queue system processes continuously without impacting site performance.

Q: Can I use this with a headless WordPress setup?

A: Perfect fit! The REST API endpoints provide JSON data for React, Vue, or mobile applications. Use /wp-json/msra/v1/posts with filtering parameters for dynamic content.

Q: Will this slow down my network?

A: No. The queue-based processing runs in the background, processing only 5-10 sites every 5 minutes. Smart caching means front-end queries are lightning fast.

Support

For support, feature requests, or custom development, please visit brianwinum.com

Performance Benchmarks

  • 50 subdomains: ~5 minute full refresh
  • 200 subdomains: ~20 minute full refresh
  • 500 subdomains: ~50 minute full refresh
  • 800 subdomains: ~80 minute full refresh

All processing happens in background without affecting site visitors.

Contributing

We welcome contributions! Visit our GitHub repository for development guidelines and feature roadmap.

Ready to unify content across your WordPress multisite network? Install Multisite RSS Aggregator today and transform your distributed content into powerful, centralized feeds.

What's New in Version 2.0.0

🚀 Performance Optimization for Large Networks

  • Queue-Based Processing: Revolutionary background processing system handling 800+ subdomains
  • Batch Processing: Configurable batch sizes (5-10 sites) preventing timeouts
  • Smart Memory Management: Optimized switch_to_blog() usage reducing memory consumption by 60%
  • Automatic Retry System: Failed feeds retry up to 3 times with exponential backoff
  • Processing Status Dashboard: Real-time monitoring of queue health and progress
  • Chunked Content Handling: Large posts processed in memory-efficient chunks
  • Database Query Optimization: Indexed fields reducing query time by 75%
  • Parallel Processing Ready: Architecture supports future parallel processing

📊 Advanced Filtering System

  • Category Filtering: Filter aggregated content by categories across all network sites
  • Tag-Based Filtering: Aggregate posts with specific tags from any subdomain
  • Multi-Parameter Filtering: Combine categories, tags, and post types in single query
  • Search Integration: Full-text search across aggregated content (coming in 2.1)
  • Dynamic Filter Combinations: AND/OR logic for complex content queries
  • Real-Time Filter Application: No need to regenerate feeds when changing filters
  • Filter Persistence: Save filter presets for quick access

🔧 Custom Post Type Support

  • Universal Post Type Detection: Automatically discovers all network post types
  • Flexible Configuration: Select any combination of post types to aggregate
  • Per-Site Post Types: Different sites can contribute different content types
  • Post Type Mapping: Map similar post types across sites (event → events)
  • Custom Field Support: Aggregate post meta data (coming in 2.1)
  • Media Post Types: Support for audio, video, and gallery post types

🌐 REST API Implementation

  • Modern JSON Endpoints: /wp-json/msra/v1/posts and /wp-json/msra/v1/sites
  • Full Parameter Support: limit, order, categories, tags, post_type, sources
  • CORS Headers: Configurable cross-origin resource sharing
  • Authentication: Optional authentication for private networks
  • Pagination Support: Efficient data retrieval for large result sets
  • Custom Response Formats: Extensible output formatting
  • Rate Limiting: Built-in protection against API abuse
  • Webhook Support: Coming in version 2.1

🎯 Widget System

  • Drag-and-Drop Interface: Visual widget configuration in WordPress customizer
  • Multiple Widget Instances: Different settings per widget placement
  • Live Preview: See changes without saving
  • Advanced Display Options: Show/hide source, date, excerpt, images
  • Responsive Design: Mobile-optimized widget layouts
  • Widget Caching: Independent cache per widget instance
  • Custom Widget Templates: Override templates in theme

Previous Updates (Version 1.0.0)

🏗️ Core Aggregation Engine

  • Automatic Subdomain Discovery: Detects all network sites automatically
  • Centralized Database Storage: Efficient aggregated content table
  • Hourly Synchronization: Configurable update frequencies
  • Source Attribution: Maintains original post ownership
  • 30-Day Retention: Automatic cleanup of old content

📡 Feed Generation System

  • Dual Feed Formats: Recent and random ordering options
  • RSS 2.0 Compliance: Full specification adherence
  • Custom Feed URLs: /feed/multisite/ endpoints
  • Feed Caching: Reduces database queries by 90%
  • Conditional GET Support: Bandwidth-efficient feed updates

⚙️ Administrative Interface

  • Network Admin Integration: Centralized management console
  • Per-Site Settings: Individual opt-in/opt-out controls
  • Visual Status Indicators: At-a-glance network health
  • Bulk Operations: Enable/disable multiple sites simultaneously
  • Settings Import/Export: Backup and migrate configurations
Visited 2 times, 1 visit(s) today