йȵITվ
|
|

Ϊʲô˵Spark SQLԶԶԽMPP SQL

MPP SQL Spark SQL һӼSpark SQL ΪһֿԽĽ̬MPP SQL Spark SQL һӼ

ߣԴ36|2016-07-01 14:37

Tech Neoɳ | 1125ţ/ZStackһ̽ʱ߽ʵ


ǰ

˵IJܣΪûԶԱȹ(Ļм򵥵˵)dzԴijָһεĵĽǶȥΪʲôSpark SQL ԶԶԽMPP SQLġ

Spark SQL MPP SQL ʵһάϡ֮

MPP SQL Spark SQL һӼ

Spark SQL ΪһֿԽĽ̬

MPP SQL Spark SQL һӼ

MPP SQL ҪļǺݵIJѯ⡣ʵʳ㻹ԼһЩδʻ㣬Ʃ뼶Ad-hoc ֮ࡣ

ʵҵ

̽ҵ񣬱KPIάûѯݿѧݵ

Ӫҵ񣬱籨(ںܶBIϵͳȫSQL)Ӫʱͳ

ҵ񣬲ȽdzԡȻʵĵķӦҪһЩͳ࣬ѧϰȼ֧

άҵ񣬱ʵʱѯ鿴ϵͳ־

MPP SQL һƵģHAWQ,Impala ȶǻMPPܹġȻڴˡЩSpark SQL ĿǰѾˣMPP SQL飬Spark SQLɵĺƯ

Spark ȫƽ̨(ƯDataSource APIԼ̵Ŭ),Spark SQL ϿԶԽ칹ԴзͲѯ

ܿٶ˵䣺

һЩиӴ洢ʽļĵƩCarbonData, Spark SQL Ѿʵֺݵ뼶ѯ

Spark ͨTungstenĿŻ(ǴԶ)ٶԽԽͣJVMƩGCԽһͨoff-heapķʽ١

Spark SQL MPP SQLϵIJҲԽԽС

Spark SQL ΪһֿԽĽ̬

Spark ͨʹDS(2.0ͳһDF DSʹһSQL)ǿ˽⣬ζSQL(DS)ΪͳһĽʽʽѯѧϰȴ򳣼κһϵͳDzģҲɼSparkŶӵij

еƪʵ²Spark ŶӶSpark core(RDD)Dzע̫ˣԿʼɧ

ٻعͷdzһЩҵ

ʵʱҵ

̽ҵ

Ԥҵ

Ӫҵ

Щҵ񶼿ʹSpark ʵ֡ͳһĽӿڶDS(DF/SQL),DS/SQL һ׼òҹ㷺ռͽܵġ

ȻSpark ҲһģԭʽAPI, DF DS ҲAPI,澭չDatabricks ŶҲڻ˼ɳǰѾеĻۣڵһ

ԱDS/SQL ѾΪRDD API ⣬һͨõģͳһĽʽAPIʽʽѯѧϰȴҲǵһδͳһĿǰҲSparkƽ̨ϵʵ֣ǵĴݵʹúѧϰżһͣǧ

RDD VS DS/SQL

DS/SQL һȣ޵ıԣζSpark ŶӿõŻҲζżͣԺ϶ȡõƽ⡣

༭Ƽ

  1. ֮𽥳ԭ֮ƣSpark 2.0ԤذϮ
  2. ֮Spark10Hadoop3.0Щʵԣ
  3. 2 Ӷݿ Hadoop Spark ͬ
  4. ΢ʽ SQL Server 2016
  5. Spark SQL Ǻηʥ?
α༭ TEL01068476606

0
:
Ҷڿ
ϲ

Ƶγ+

ݷʦְҵ滮Ƶγ

ݷʦְҵ滮Ƶγ

ʦų22ѧϰ

̻H5СϷƵγ

̻H5СϷƵγ

ʦԶ2ѧϰ

RESTfulƵγ

RESTfulƵγ

ʦ˻2ѧϰ

ְλ+

+

JSPӦÿ()

JSPServlet¹淶ӻ﷨͹淶֣ԾΪܣʵΪĿ꣬ʵΪʵΪָdzؽJS...

51CTOʿ

51CTOʿ
Phthonı