edu.snu.coral.compiler.frontend.spark.sql

Class SparkSession

java.lang.Object

org.apache.spark.sql.SparkSession

edu.snu.coral.compiler.frontend.spark.sql.SparkSession

All Implemented Interfaces:

Closeable, Serializable, AutoCloseable, org.apache.spark.internal.Logging

public final class SparkSession
extends org.apache.spark.sql.SparkSession

A simple version of the Spark session, containing SparkContext that contains SparkConf.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	SparkSession.Builder Spark Session Builder.

Nested classes/interfaces inherited from class org.apache.spark.sql.SparkSession

org.apache.spark.sql.SparkSession.implicits$

Method Summary

Modifier and Type	Method and Description
static SparkSession.Builder	builder() Get a builder for the session.
static SparkSession	from(org.apache.spark.sql.SparkSession sparkSession) Method to downcast Spark's spark session to our spark session class.
DataFrameReader	read()

Methods inherited from class org.apache.spark.sql.SparkSession

applySchemaToPythonRDD, applySchemaToPythonRDD, baseRelationToDataFrame, catalog, clearActiveSession, clearDefaultSession, cloneSession, close, conf, createDataFrame, createDataFrame, createDataFrame, createDataFrame, createDataFrame, createDataFrame, createDataFrame, createDataFrame, createDataFrame, createDataset, createDataset, createDataset, emptyDataFrame, emptyDataset, experimental, extensions, getActiveSession, getDefaultSession, implicits, initializeLogIfNecessary, internalCreateDataFrame, isTraceEnabled, listenerManager, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning, newSession, org$apache$spark$internal$Logging$$log__$eq, org$apache$spark$internal$Logging$$log_, parseDataType, range, range, range, range, readStream, sessionState, setActiveSession, setDefaultSession, sharedState, sparkContext, sql, sqlContext, stop, streams, table, table, time, udf, version

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

read

public DataFrameReader read()

Overrides:

read in class org.apache.spark.sql.SparkSession

from

public static SparkSession from(org.apache.spark.sql.SparkSession sparkSession)

Method to downcast Spark's spark session to our spark session class.

Parameters:

sparkSession - spark's spark session.

Returns:

our spark session class.

builder

public static SparkSession.Builder builder()

Get a builder for the session.

Returns:

the session builder.