Big Data

Automate aws snapshot using Lambda and cloudwatch service

Author - Navneet Kashyap
|
0 Comments
|

Automate the Snapshots using AWS Lambda & CloudWatch services.

Step.1 Create IAM Role with following accessibility

1. To get information of volumes and snapshots from EC2
2. To create new snapshots using the CreateSnapshot API call
In the AWS management console, go to Read more…

How to close Heroku Postgres Database connections

Author - Kailash Kumar
|
0 Comments
|

Problem: Heroku Postgres Database Fatal error too many database connections for role ‘username’

Solution:
1. First install Heroku toolbelt with command
a. sudo snap install heroku –classic
2. Login from command line
a. heroku login
3. Check current database connections
a. heroku pg:info Read more…

How to run CakePHP 3.7 Shell Commands in Heroku console

Author - Kailash Kumar
|
0 Comments
|

Learn how to run CakePHP 3.7 Shell Commands in Heroku console

1. Create myCommandShell.php file in src/Shell folder with below content

<?php
namespace App\Shell;
use Cake\Console\Shell;
use App\Controller\PagesController;
class myCommandShell extends Shell {
public function main() {
// do your Read more…

Invalid value for header \u0067x-ms-request-id\u0067

Author - Harleen Kaur
|
0 Comments
|

Resolved Issue

“Invalid value for header \u0067x-ms-request-id\u0067. The header must contain a single valid GUID”

I was facing the issue “Invalid value for header \u0067x-ms-request-id\u0067. The header must contain Read more…

Converting XML file to CSV in Talend Open Studio

Author - Richa Sharma
|
0 Comments
|

The following process shows the step-by-step procedure to convert an XML file to CSV.

Sample XML file:- PaymentMode.xml
<?xml version=”1.0″ encoding=”ISO-8859-15″?>
<paymentModes>
<paymentMode>
<id>1</id>
<mode>Cash Read more…

Hadoop | ServerNotRunningYetException and PleaseHoldException

Author - Webner
|
0 Comments
|

Problem 1: ERROR: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet

While running the hbase shell sometimes we receive Server is Not Running Yet error while our hbase master server is running properly.

Solution: This problem occurs when we fetch the data from the hdfs for hbase Read more…

Hadoop | Creating and running Mapreduce Programs in Eclipse and from Command line

Author - Webner

We can create and run the java Mapreduce programs in Eclipse as well as from command line.
Using Eclipse – For Eclipse first we have to install the plugin for hadoop mapreduce which inherits the libraries required to implement the mapreduce functionality. After this we have to build the path which Read more…

Why Hadoop and Big Data are getting popular

Author - Webner

Surprisingly, over 90% of the data in the world today has been created only in the last couple of years. With the revolution in mobile industry, social media networks, sharing of digital photos and videos online we are continuing to grow the world’s data at lightning speed. To manage Read more…