Transforming an Elasticsearch Solution to OpenSearch Service for Streamlined Business Operations
Cloudtech supports global IT staffing company with new log analytics solution to reduce costs and service downtime
About
A global IT staffing company that serves customers in every major vertical from startups to Fortune 100 companies, was looking to modernize their business operations so they could more reliably make data-driven business decisions.
Business Challenge
The IT staffing company initially built a dual-purpose system that functioned as both a customer relationship management and enterprise resource planning tool. While custom-built for their own specifications, the existing system created some unique business challenges - specifically in the log analytics portion of the tool built on Elasticsearch.
The first challenge was price; between the Elastic licensing fees and the cost of labor associated with upkeep and maintenance, it was not a cost-effective solution. Next was reliability; the system was prone to frequent downtime and performance issues. Add to that, the business disruptions caused both internally and externally, signaled that the customer was ready for a change.
Technical Challenge
Cloudtech analyzed their data infrastructure, and determined that the current solution - self-managed ELK stack - to be suboptimal compared to the licensing fee costs. Also, the solution required eight engineers to maintain and troubleshoot.
In addition, data streams were vulnerable to disruption, and lack of shard availability and rebalancing issues caused frequent search throughput breakdowns. Lastly, upgrading the solution was tedious and time-consuming, taking up to a month in some cases.
%20-%20Anonymized-diagram.png)
Log Analytics Solutions
Based on the challenges, Cloudtech proposed a centralized logging platform using Amazon OpenSearch Service, AWS Fargate, Amazon Elastic Container Registry (ECR), and Amazon Elastic Kubernetes Service (EKS). This platform provided the customer with the scalability and data integrity required to store and analyze logs generated by their CRM/ERP tool. Given that cost and maintenance were important issues to address, Amazon OpenSearch Service was chosen for its speed, price, and security. Additionally, as a managed service, it alleviated the maintenance overhead associated with the previous solution.
“The cost savings and downtime reductions we experienced were far above anything we expected, and have since significantly impacted our business in a positive way. The insights we get from reliable log analytics are driving our business forward.”
- CTO, IT Staffing Company
Log Analytics Solution Results
Cloudtech’s solution enabled the customer to centralize their logs, process logs in real-time, gain insights, and make data-driven decisions. Amazon OpenSearch Service made it easier to perform search operations, enhance search efficiency, and provide scalable searching. In fact, the ability to scale up and down in minutes improves search throughput. In addition, OpenSearch Service allows the customer to schedule service software and auto-tune updates during off-peak hours, helping to better plan their deployments. Most importantly, the customer realized 40% cost reduction and 80% reduction in downtime.
Reduce Costs with Log Analytics Solution
Implement your own data processing and log analytics solution, and realize the business benefits of reduced downtime, optimized costs, and improved business decisions. Contact Cloudtech today.