Follow

**Introduction**
YaCy is a decentralized search engine with open-source code, written in Java. However, its performance and scalability are limited by the current choice of technologies. This project aims to create a reference server to test the transition of YaCy to more efficient programming languages, such as C++, C, Rust, and Go.
**Objective**
- Research the performance and efficiency of alternative languages in the development of decentralized search engines.
- Optimize the use of hardware resources, including multi-core systems, large memory capacities, and GRAID.
- Provide better multi-threading support and expand the search algorithm capabilities.
- Reduce dependency on JVM to increase speed and minimize resource usage.
**Hardware Platform**
The project involves using a reference server with the following specifications:
- **RAM**: 1–10 TB (depending on configuration and indexing volume)
- **Processors**: 4–16 Intel server processors
- **Co-processors**: Nvidia graphics cards for processing large data volumes
- **Storage**: GRAID to improve data access speed and reduce latency
- **Network Interaction**: Optimized network protocols for efficient data exchange between nodes
**Development Stages**
1. Analyze the current YaCy architecture and identify key limitations.
2. Select suitable programming languages (C++, C, Rust, Go) and test their capabilities.
3. Develop a prototype for an alternative search engine core.
4. Integrate with the existing infrastructure and test performance on the reference server.
5. Evaluate efficiency and further improve algorithms.
**Expected Outcomes**
- Enhanced search engine performance through the effective use of multi-core processors and GRAID.
- Reduced RAM usage and increased indexing speed.
- Greater system stability and scalability.
- The potential for further adaptation of the new codebase for use in other decentralized projects.
This project will lay the foundation for future improvements in decentralized search systems and demonstrate the possibility of creating a high-performance alternative to YaCy using modern technologies.
**Project of a reference server for deployment and exploration of the transition of YaCy to C++, C, Rust, Go codebase with 1-10 TB of RAM and GRAID, 4-16 Intel processors, and Nvidia graphics cards as co-processors.**
**Keywords**: YaCy, P2P, search engine, C++, Rust, Go, GRAID, Intel, Nvidia, co-processors, big computing, decentralized search.

@pureacetone color me interested. Of what project are we talking about?

Sign in to participate in the conversation
Qoto Mastodon

QOTO: Question Others to Teach Ourselves
An inclusive, Academic Freedom, instance
All cultures welcome.
Hate speech and harassment strictly forbidden.