The Company already had an existing portal wherein collecting and processing all posts was completely manual while being devoid of automation and other features. Manually collecting posts from various social media based on certain keywords was becoming challenging and time-consuming. Also, scaling was almost impossible. Another problem was that manually processing all the posts from various sources became extremely complicated and prone to errors. The existing portal also did not support role management as far as client, staff, and admin logins were concerned. Along with that, the client was also facing issues in creating clean and informative visualizations using their existing portal.
First, we built a system that automatically collects data from various social media based on certain keywords. We also provided a system for uploading data manually from any other offline source. For processing all the data accurately and efficiently, we used a combination of 3rd party APIs and some custom-built APIs. One potentially major issue that we faced while using AWS Lambda services was that it had many limitations on the number of requests it could handle at a time.
We also built a batch system that sent a particular number of requests at a time to solve the issue of limitations in the number of requests that could be handled at a time. As far as role management was concerned, we built a system where each user assigned to a particular role would have a certain access level. For auto-visualization and reporting in a very clean and informative way for their clients, we also built a customized dashboard by collating required data from sources identified by the client.
Social Media Aggregation
Data from multiple social media platforms like Facebook, Twitter, Instagram, YouTube, Reddit, etc. were aggregated for relevant Hashtag and Keyword inputs.
Transcription & Translation
There were cases where the videos on YouTube and other offline sources were in different languages, which necessitated this feature.
All the collected data were analyzed on various parameters of sentiments and were assigned positive, negative, or neutral scores.
Advanced Search capabilities
Elastic search-based system including Fuzzy search was incorporated for enhanced search experience.
Reporting & Dashboard
Considering the amount of data collected and stored, the dashboard needed to be designed in such a way that provided a single-window view of important parameters.
The architecture was designed in such a way that the portal ran for multiple clients on multiple servers.
Need a custom software application for your buisness?
We at TechVarible do acknowledge that one size will not fit all. Hence, we work in collaboration with you to identidy, analyze & then develop a solution that fulfils your needs.
Either we will define the functional scope of your project to estimate the timeline and budget or you can create your own agile team from among our recources.
High level design architecture
Product Lifecycle Management
Angular, JAVA (Springboot), Angular.js, AWS, Elastic Search, j, Neo4, Node.js, Python
Customized Customer Relationship Management
Apache, MongoDB, Nodejs, React.is
Write to us
We follow all kinds of protocols & best practices to ensure that security as well as compliance requirements are met independent of client location & project size.