• About Me

Khode Prasad

~ Java, J2EE & Hadoop Engineer

Khode Prasad

Tag Archives: Integration

Read data from Cassandra tables using Apache Spark

12 Thursday Nov 2015

Posted by Prasad Khode in Cassandra, Hadoop, Spark

≈ 3 Comments

Tags

Cassandra, Cassandra Spark Integration, Hadoop, Integration, READ, Spark

Apache Cassandra is an open source distributed database management system designed to handle large amounts of data across many commodity servers, providing high availability with no single point of failure. Cassandra offers robust support for clusters spanning multiple datacenters, with asynchronous masterless replication allowing low latency operations for all clients.

Apache Spark is an open-source cluster computing framework originally developed in the AMPLab at UC Berkeley. In contrast to Hadoop’s two-stage disk-based MapReduce paradigm, Spark’s in-memory primitives provide performance up to 100 times faster for certain applications. By allowing user programs to load data into a cluster’s memory and query it repeatedly, Spark is well-suited to machine learning algorithms. Continue reading →

Advertisements

Share this:

  • Click to share on Twitter (Opens in new window)
  • Click to share on Facebook (Opens in new window)
  • Click to share on Google+ (Opens in new window)
  • Click to share on LinkedIn (Opens in new window)
  • Click to print (Opens in new window)

Like this:

Like Loading...

Insert records into HBase table using Java

29 Wednesday Jul 2015

Posted by Prasad Khode in Hadoop, HBase, Java

≈ 1 Comment

Tags

Configuration, Insert, Integration, Java, Java HBase, Records, Table

For latest updates on this post check
my new blog site

hbase-client.jar will be used to get connected to HBase using Java and this is available in maven repository. The following dependency can be added in our pom.xml

<dependency>
    <groupId>org.apache.hbase</groupId>
    <artifactId>hbase-client<artifactId>
    <version>1.1.0.1</version>
<dependency>

Once we have added the dependency we need to create Configuration object specifying core-site.xml and hbase-site.xml as resources. Continue reading →

Share this:

  • Click to share on Twitter (Opens in new window)
  • Click to share on Facebook (Opens in new window)
  • Click to share on Google+ (Opens in new window)
  • Click to share on LinkedIn (Opens in new window)
  • Click to print (Opens in new window)

Like this:

Like Loading...

Create a website or blog at WordPress.com

Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
To find out more, including how to control cookies, see here: Cookie Policy
%d bloggers like this: