Finding an Efficient Solution on Reading and Comparing CSV files

I have always worked with Linux Systems and thus Bash was my go to tool for some specific tasks. But now I am much more aware with Python than Bash as it does give me better grasp on things. I am not saying that for server scripting, Bash can not do some tasks. It can be used in a vast area of things to solve. But I am now comfortable with Python more.

Recently, I did stumble upon of a task that was related to comparing two huge CSV files.

Continue reading Finding an Efficient Solution on Reading and Comparing CSV files

SSH Config and Ansible Host Generator and Why I am doing it this way?

I am recently playing the role as an SRE and that is why I have to deal with a lot of servers. Not only cloud once or clusters but also bare metals as well as Virtual Machines. For more systematic environment preparation, I have Gitlab pipeline. But for basic tasks like change the config on demand or check a specific directory or search something or any other unpredictable or repeated tasks, I need Ansible for better grasp from my local machine or Bastion server. So, what do I have to do?

  • Create an entry to the .ssh/config file
  • Create an entry ansible host file as inventory

Repeated tasks? For me, yes. I needed to manage these. So, created a python script

Continue reading SSH Config and Ansible Host Generator and Why I am doing it this way?

My Understanding about RUN, CMD and ENTRYPOINT in Dockerfile

Containerization gives us many benefits from packaging to distribution and others. Thus, Docker is widely used as a containerization tool which is designed for running specific tasks and processes, not for hosting operating systems or like other virtualization tools like VMWare, VirtualBox etc. You create a container to serve a single unit task. Once it completes the given task, it stops. The container life-cycle depends on the ongoing process inside of it. Once the process stops,

Continue reading My Understanding about RUN, CMD and ENTRYPOINT in Dockerfile

Effective use of Redis with Python and Connection Pool

I have been working with redis and python for sometime. It is fun to play with python and redis. There are so many things can be solved by redis.

  • Session persistency
  • Caching
  • Volatile Datastore
  • Job or Message Queue
  • Search

And many more. But recently I was thinking about using it as main database. I am not yet sure what kind of problem I might face or what things to optimize when it is about scalability or reliability. I will for sure share my experience.

Here I want to talk about –

Continue reading Effective use of Redis with Python and Connection Pool

How to run Python Flask Application?

I mostly use Python Flask when I need to develop a Web App or API.

Why? Because it is:

  • lightweight
  • Very Flexible
  • Micro-Service Friendly
  • Fast Development

These are one of the main reasons I choose Flask. But mostly I love to code with Flask. There are so many ways to run flask applications. I will write some of them here with code examples.

Continue reading How to run Python Flask Application?
%d bloggers like this: