Posts

Showing posts with the label Hadoop

Reverse Email Lookup using Proxycurl

Image
    Ever wonder what information you can get from the email of a person? The information that you can get only from the Email address are: Email address owner information Email address owner Country Job profile and associated social media account linked with the Email address You can also get the phone number, permanent address and profile picture of the Email address owner Now you might be thinking HOW?  Using Reverse Email Lookup Reverse Email Lookup:  Reverse email lookup is the process of finding the identity of an email sender by using their email address. This can be used to confirm the identity of an email sender or to find out more information about them. Use case of Reverse Email Lookup: Scam and Fraud Prevention Verification of Ecommerce Transactions Credit Risks Analysis HR Talent Identification To know more about Reverse Email Lookup check the blog  3 Simple Methods To Do Reverse Email Lookup How to perform Reverse Email Lookup? Here comes Proxycurl ...

Integrating LVM with Hadoop and providing Elasticity to Datanode Storage

Image
  What is LVM? LVM is a tool for logical volume management which includes allocating disks, striping, mirroring and resizing logical volumes. With LVM, a hard drive or set of hard drives is allocated to one or more physical volumes. LVM physical volumes can be placed on other block devices which might span two or more disks. What is Hadoop? The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. Rather than rely on hardware to deliver high-availability, the library itself is designed to detect and handle failures at the application layer, so delivering a highly-available service on top of a cluster of computers, each of which may be prone to failures. Let's get started: First launch an instance in AWS and configure it as Master launch an instance in ...

Hadoop Commands

Image
  Commands hadoop dfsadmin -report #this command shows information about the Datanodes           connected to Masternode. hadoop fs  -put filename / #this command uploads file hadoop fs -cat /filename   #this command reads the file. hadoop fs -ls / #this command shows the uploaded file. hadoop fs -rm /filename #this command remove the file hadoop namenode -format #this command formats the directory created in Namenode hadoop-daemon.sh start namenode #this command starts the namenode hadoop-daemon.sh start datanode #this command starts the datanode hadoop-daemon.sh stop namenode #this command stops the namenode hadoop-daemon.sh stop datanode #this command stops datanode hadoop dfsadmin  -safemode leave#this command turns off the save mode.

What is Big Data ?

Image
Are you curious? Did you ask yourself a question that all-day I use social media, like the post, add comments, download images and upload images, Where does this all data is stored ?. Big companies get millions of data per data where they store data? Don't worry you will get all your answers here, just give it a read. India has  574 million  active Internet users as of 2019. India is the second-largest online market, behind China. It is estimated that by December 2020 there will be around  639 million  active internet users in India. The majority of India’s internet users are mobile phone internet users,  who take advantage of cheap alternatives to expensive broadband/ Wi-Fi connections that require PC, laptop, and other equipment. Indian mobile data users consume  11 gigabits (GB)  of data each month on average, India is the highest globally, ahead of markets like C...