Category: Big Data
Automate aws snapshot using Lambda and cloudwatch service
Automate the Snapshots using AWS Lambda & CloudWatch services. Step.1 Create IAM Role with following accessibility 1. To get information of volumes and snapshots from EC2 2. To create new snapshots using the CreateSnapshot API call In the AWS management
How to close Heroku Postgres Database connections
Problem: Heroku Postgres Database Fatal error too many database connections for role ‘username’ Solution: 1. First install Heroku toolbelt with command a. sudo snap install heroku –classic 2. Login from command line a. heroku login 3. Check current database connections
How to run CakePHP 3.7 Shell Commands in Heroku console
Learn how to run CakePHP 3.7 Shell Commands in Heroku console 1. Create myCommandShell.php file in src/Shell folder with below content <?php namespace App\Shell; use Cake\Console\Shell; use App\Controller\PagesController; class myCommandShell extends Shell { public function main() { // do your
Invalid value for header \u0067x-ms-request-id\u0067
Resolved Issue “Invalid value for header \u0067x-ms-request-id\u0067. The header must contain a single valid GUID” I was facing the issue “Invalid value for header \u0067x-ms-request-id\u0067. The header must contain a single valid GUID” while making request to the Azure Database
Converting XML file to CSV in Talend Open Studio
The following process shows the step-by-step procedure to convert an XML file to CSV. Sample XML file:- PaymentMode.xml <?xml version=”1.0″ encoding=”ISO-8859-15″?> <paymentModes> <paymentMode> <id>1</id> <mode>Cash</mode> </paymentMode> <paymentMode> <id>2</id> <mode>Debit Card</mode> </paymentMode> <paymentMode> <id>3</id> <mode>Credit Card</mode> </paymentMode> <paymentMode> <id>4</id> <mode>Paytm</mode> </paymentMode>
Hadoop | ServerNotRunningYetException and PleaseHoldException
Problem 1: ERROR: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet While running the hbase shell sometimes we receive Server is Not Running Yet error while our hbase master server is running properly. Solution: This problem occurs when we fetch the data
Hadoop | Creating and running Mapreduce Programs in Eclipse and from Command line
We can create and run the java Mapreduce programs in Eclipse as well as from command line. Using Eclipse – For Eclipse first we have to install the plugin for hadoop mapreduce which inherits the libraries required to implement the
Why Hadoop and Big Data are getting popular
Surprisingly, over 90% of the data in the world today has been created only in the last couple of years. With the revolution in mobile industry, social media networks, sharing of digital photos and videos online we are continuing to