BitsBySugar Develops Services Monitoring System for Client
Overview
BitsBySugar, specialized in developing advanced CRMs, custom-tailored monitoring tools, inventory management systems, etc., was approached by a client, whose name is withheld due to a non-disclosure agreement (NDA), to develop a Services Monitoring System. The system was required to generate analytics and monitoring data from various services like LastPass, AWS, Google Cloud, GSuite, and GitHub into a single unified dashboard. The client faced challenges in manually monitoring different dashboards for each service and wanted a real-time insights solution. We developed a cutting-edge modern system using technologies like NestJS, TypeORM with Postgres for database, NextJS for frontend, GraphQL, and docker. The developed system significantly reduced the client's reliance on manual monitoring and provided real-time insights, along with automated alerts via email.
Challenges
Before approaching the BitsBySugar the client had been manually monitoring various dashboards for each service. This was a time-consuming task and provided limited insights. Additionally, the client had to rely on different dashboard systems to get a holistic view of the services being monitored. The client wanted a solution that could generate analytics and monitoring data from multiple services in real-time and provide unified insights. The client was specifically looking for a solution that could provide real-time updates to LastPass and GraphQL tools, report downtimes of EC2, RDS instances, code deployment status of AWS, and immediately notify about vulnerabilities in new code pushes and status of triggered GitHub actions.
To monitor endless services client needed a full-time employee which meant 160 Hrs wasted maintaining services data records over Excel and reporting back with the same to the CEO. The inefficient method at times resulted in data discrepancies and a delay in reporting cases which should have been expedited, to say the least.
Solution
BitsBySugar proposed a Services Monitoring System that would bring together analytics and monitoring data from multiple services into a single unified dashboard. The system was developed using modern technologies like NestJS, TypeORM with Postgres for database, NextJS for frontend, GraphQL, and docker. The system's architecture was designed to ensure scalability, flexibility, and easy maintenance. The team also implemented a serverless architecture, with AWS load balancers for zero downtime and easy scalability. The load on the database and request latency was reduced with proper caching implemented with Redis.
- The system was integrated with various services like LastPass, AWS, Google Cloud, GSuite, and GitHub using APIs to pull data in real-time. The data was then processed and analysed using advanced algorithms to generate insights. The unified dashboard provided a holistic view of all the services being monitored and provided real-time insights into the health and performance of each service.
- With the LastPass monitoring tool, the client was able to view and authorize new users, check passwords at risk, and manage access control. The GSuite tool provided real-time updates to users, allowing them to stay up-to-date with their tasks and appointments. The AWS tool reported downtimes of EC2, RDS instances, code deployment status, and helped in identifying potential issues before they affected the system. The GitHub tool immediately notified the client of vulnerabilities in new code pushes and the status of triggered GitHub actions.
- The system also included automated alerts via email, which notified the client in real-time when an issue was detected. This helped the client to take immediate action and minimize the impact of any service disruption.
Result
The Services Monitoring System developed by the team of BitsBySugar provided the client with a unified view of all the services being monitored, reducing their reliance on manual monitoring. The real-time insights and automated alerts helped the client to detect issues quickly and take immediate action. This significantly reduced the downtime of services and improved the overall performance of the client's business.
The system's cutting-edge modern technology ensured scalability, flexibility, and easy maintenance, reducing the client's future IT costs. The system was also designed with security in mind, ensuring the client's data was protected at all times.
The entire project was completed in a record of 3 months.
Tech Stack Used
- NodeJS (NestJS - Typescript) as the backend framework
- TypeORM with Postgres for Database
- CI/CD Tool Used: Gitlab CI/CD
- Cloud Infrastructure: AWS with Load Balancers on AWS ECS
- NextJS to serve frontend.