Achievements

Arctic Code Vault Contributor
IPv6 Certification Badge for Robert Whitney

This page has been visited an unknown number of times.
Page last generated:
2025/06/15 10:36:00.

Introducing BBCrawler: The Fastest and Most Scalable Minecraft Server Scanner

This post was written 2024-12-25 01:30:00 -0800 by Robert Whitney and has been viewed an unknown number of times since unknown time. This post was last viewed an unknown length of time ago.

BBCrawler is a fast and scalable Minecraft server scanner designed to meet the needs of gamers, developers, and enthusiasts. The BBCrawler ecosystem is composed of distinct yet interconnected services, each contributing to its robust functionality. Here's what it offers:

  • Discord Bot: The Discord bot serves as the primary interface for interacting with other services. It allows users in specific roles to perform different tasks. For example:
    • Users in a designated role can execute scans to discover new servers.
    • Users with limited permissions can search through the servers already cataloged in the database.
  • Scanner: The scanner is designed to sweep IP ranges for Minecraft servers efficiently. By leveraging advanced scanning techniques, it ensures comprehensive discovery of active servers.
  • Pinger: The pinger operates as a monitoring tool. Once servers are identified, it continuously monitors them for vital information, such as:
    • Player count
    • MOTD (Message of the Day)
    • Server version and more
  • Alert System: BBCrawler can monitor servers and send real-time alerts through Discord webhooks, ensuring users stay informed about server activity.
  • API: The API facilitates seamless interaction with the database and other services. It can also be integrated into external applications, offering flexibility for custom development.
Screenshot of the scanner and pinger logs of BBCrawler

Why Choose BBCrawler?

BBCrawler's modular design sets it apart from other server scanning tools. By dividing its functionality into separate components, it achieves unparalleled speed and efficiency. Here are the key advantages:

  • Scalability: The scanner application can be deployed across multiple servers to distribute the workload. This approach increases scanning speed and ensures a broader range of IPs can be covered simultaneously.
  • Security: Running scanners separately from other components protects the server hosting critical services, reducing exposure to potential threats.
  • Efficiency: With the ability to scan more hosts at once, BBCrawler is the most efficient and advanced Minecraft server scanner available in the open-source market.

Deployment Made Simple

BBCrawler includes examples to simplify deployment:

  • Docker Integration: The repository provides example docker-compose.yml and .env files. These can be customized to suit your setup and renamed for immediate use.
  • Service Flexibility: Examples are provided for running individual services (such as the scanner or pinger) independently, catering to various use cases.

How It Works

  • Scanner: BBCrawler utilizes massscan to identify open Minecraft servers within specified IP ranges. When a server is detected, the scanner passes its IP and port information to the pinger.
  • Pinger: The pinger retrieves server details, including MOTD, player count, and version.
  • API: The API periodically checks the database for servers that haven't been recently pinged and sends them back to the pinger. Additionally, it handles requests from the Discord bot. You can:
    • Use the API to build your own front-end.
    • Expose the API to the internet, enabling others to access it.
    • Create or fork a Meteor add-on to integrate with your client.
  • Discord Bot: The Discord bot is the primary interface for interacting with BBCrawler. It allows users to:
    • Start scans directly from Discord.
    • Search the server database with ease.
    • Receive real-time alerts through Discord webhooks.

View on GitHub Join our Discord