Viddl is a ruby command line utility that can be used to download video from youtube. You can easily download, cut, crop and resize video clips using Viddl. In this tutorial, we will see how to install Viddl on CentOS [...]
Linoxide
How to Import Data from MySQL to HDFS Using Sqoop
Apache Sqoop is a tool in Hadoop ecosystem which is used to import/export data between RDBMS and HDFS. This data is in structured format and has a schema. There are multiple cases where you want to analyze some data in [...]
How to Run Hadoop MapReduce Program on Ubuntu 16.04
In this blog, I will show you how to run a MapReduce program. MapReduce is one of the core part of Apache Hadoop, it is the processing layer of Apache Hadoop. So before I show you how to run a [...]
How to Setup Single Node Hadoop Cluster Using Docker
In this article, I will show you how to setup a single node hadoop cluster using Docker. Before I start with the setup, let me briefly remind you what Docker and Hadoop are. Docker is a software containerization platform where [...]
How to Deploy Spark Application on Yarn and Integrate with Hive
In this article, I will tell you working of Spark with YARN and Hive. Before I begin, let me briefly tell you what Apache Spark, YARN and Apache Hive are. Apache Spark is an in-memory distributed processing framework. Spark is used [...]
Awesome ! Hadoop HDFS Commands Cheat Sheet
HDFS is now an Apache Hadoop subproject. An HDFS instance contains of vast amount of servers and each store a part of file system. A typical file size in HDFS would be in gigabytes or terabytes in size hence applications [...]
How to Install Apache Sqoop on Ubuntu 16.04
Apache Sqoop is a tool designed for efficiently transferring bulk data between Apache Hadoop and structured datastores such as relational databases. For example : MySQL, Oracle, Microsoft SQL Server. You can import and export data between relational databases and hadoop. You [...]
30 Most Frequently Used Hadoop HDFS Shell Commands
In this tutorial, we will walk you through the Hadoop Distributed File System (HDFS) commands you will need to manage files on HDFS. HDFS command is used most of the times when working with Hadoop File System. It includes various shell-like commands [...]
How To Set Up Jenkins for Continuous Development Integration on Ubuntu 16
In this blog, we will set up jenkins and configure jenkins on ubuntu 16 for continuous development and continuous integration. Jenkins is a Continuous Integration server. Basically, Continuous Integration is the practice of running your tests on a non-developer machine automatically everytime someone [...]
How to Setup Hadoop Multi-Node Cluster on Ubuntu
In this tutorial, we will learn how to setup a multi-node hadoop cluster on Ubuntu 16.04. A hadoop cluster which has more than 1 datanode is a multi-node hadoop cluster, hence, the goal of this tutorial is to get 2 [...]
30 Expected DevOps Interview Questions and Answers
If you are searching for devOps job, you are making good career decisions since it is well paid and heavily demanded job nowadays. In this article, we will go through the DevOps interview questions that you might expect from your [...]
Learn Ansible Basics to Install, Create Roles, PlayBook in Linux
DevOps has become an increasingly important aspect of daily life for many systems administrators. The demand to automate as much as possible, combined with the needs for flexibility and scalability, can give the most seasoned veteran a headache. Ansible will [...]