Some guy's blog
Most folks don’t know that the Spark Cassandra Connector is actually able to connect to multiple Cassandra clusters at the same time. This allows us to move data between Cassandra clusters or even manage multiple clusters from the same application (or even the spark shell)
Spark Loves Distributed filesystems, but sometimes you just want to write to wherever the driver is
running. You may try use a file://
or something of that nature and run into a lot of strange errors
or files located in random places. Never fear there is a simple solution with toLocalIterator
.
We just fixed a bug
which was stopping DataFrames
from being able to write into Cassandra UDTs. But I noticed there
aren’t a lot of great documents around how this works. Here is just a quick example on how you can
make a dataframe which can insert into a C* UDT.
I felt the need to write this post after I read the blog post
which did a great job at explaining how fold
and foldByKey
worked. The only thing I thought
was missing from this rundown was a bit of detail on how these operations work differently than
their scala counterparts.
##Cassandra 2.1 17:06:16 ➜ ~/repos/RussellSpitzer.github.io/ExampleScripts git:(master) ✗ ./TombstoneExperiment.sh
Spark is awesome and I love it. SparkSQL is also awesome but unfortunately is not fully mature. Although the folks at DataBrix have talked about how it will eventually become as full ANSI SQL langauge that time is honestly far off. This means that most folks will want to fall back onto HiveQL for doing their more complicated queries on Spark.
I’m often confronted with people asking my why a certain technology or program isn’t fast enough. This is a good question since we should always be interested in making things fast. But usually I hear these questions in response to a perceived slowness which is hard to define or can only be explained in terms of other technologies.
I was a little tired of how difficult it was for me to manage my wordpress style blog and I love git. So after I saw a couple of my friends with their awesome github.io.pages blogs I knew I needed one as well.