Amazon Web Services (AWS) is a leading cloud computing platform that offers a wide range of services to help data engineers and scientists efficiently manage and process large amounts of data. …

In the year 2015, as a young professional starting my career in the consulting industry, I was beyond joy when I landed myself a job straight out of college. Having a source of income is a big boost to confidence. But, my happiness didn’t limit itself. As I joined, I…

As a data engineer, my job is to design and build systems that collect, store, and process large amounts of data. This involves creating pipelines that allow data to flow between different systems and ensuring that the data is organized and structured to meet the needs of data scientists and…

My journey towards creating a fast, comprehensive, and usable COVID19 Resources Search Engine — I lost someone close to me recently. He was not a blood relative but I had known him since I was a child. He was that fun uncle I knew. Yes, knew. I lost him to Coronavirus. Coronavirus or COVID19 has been looming over our heads like an apocalyptic nightmare…

In a world where data is money, databases are nothing short of banks. However, the great thing about them is their variety. They are of so many types and come with so many choices, that the data engineers like us are spoilt with it. …

Remember those conversations between BI engineers when we randomly recommended reporting tools to each other? No? Just me? Okay! Nevertheless, whenever I have had those conversations, Tableau has been my number one choice of recommendation. This is simply based on the fact that Tableau has time and again proved itself…

Recently someone in my organisation asked me about ways of backing up our performance metrics data. While having backup tables is one of the standard ways of doing it, I, super paranoid about the safety and resilience of our database started thinking about other alternatives alongside a database backup that…

With analytics taking over every aspect of our lives, it has now become a mandate for data engineers like us to ensure that the insights are always available on the go. Be it a financial project where transactions are happening every minute, or a key performance metrics project where values…

There is no question about the brilliance of the Pandas library. One of the most used libraries in data science, Pandas is a household name for data scientists, analysts and general data enthusiasts.