下载资源后端资源详情

大数据生态圈学习.zip

大小:6.73MB

价格:37积分

下载量:0

评分:

5.0

上传者:zhaoshanshan168

更新日期:2025-09-22

大数据生态圈学习.zip

资源文件列表(大概)

文件名

大小

.gitattributes

118B

.gitignore

450B

pom.xml

3.11KB

README.md

2.9KB

标签.txt

48B

资源内容.txt

839B

qs-hadoop-elasticsearch-springboot/mvnw

6.32KB

qs-hadoop-elasticsearch-springboot/mvnw.cmd

4.88KB

qs-hadoop-elasticsearch-springboot/pom.xml

3.03KB

qs-hadoop-elasticsearch-springboot/.mvn/wrapper/maven-wrapper.jar

46.49KB

qs-hadoop-elasticsearch-springboot/.mvn/wrapper/maven-wrapper.properties

110B

qs-hadoop-elasticsearch-springboot/src/main/java/com/qs/game/QsHadoopElasticsearchSpringbootApplication.java

449B

qs-hadoop-elasticsearch-springboot/src/main/java/com/qs/game/controller/BookController.java

5.86KB

qs-hadoop-elasticsearch-springboot/src/main/java/com/qs/game/dao/BookDao.java

430B

qs-hadoop-elasticsearch-springboot/src/main/java/com/qs/game/dao/impl/BookDaoImpl.java

313B

qs-hadoop-elasticsearch-springboot/src/main/java/com/qs/game/entity/Book.java

1.7KB

qs-hadoop-elasticsearch-springboot/src/main/resources/application.yml

664B

qs-hadoop-elasticsearch-springboot/src/main/resources/static/my.js

qs-hadoop-elasticsearch-springboot/src/main/resources/templates/index.html

123B

qs-hadoop-elasticsearch-springboot/src/test/java/com/qs/game/QsHadoopElasticsearchSpringbootApplicationTests.java

362B

qs-hadoop-elasticsearch-starter/pom.xml

3.38KB

qs-hadoop-elasticsearch-starter/src/main/java/com/qs/game/App.java

197B

qs-hadoop-elasticsearch-starter/src/main/java/com/qs/game/starter/IndexAPI.java

9.36KB

qs-hadoop-elasticsearch-starter/src/main/resources/elasticsearch.properties

qs-hadoop-elasticsearch-starter/src/main/resources/log4j2.properties

179B

qs-hadoop-elasticsearch-starter/src/test/java/com/qs/game/App.java

887B

qs-hadoop-elasticsearch-starter/src/test/java/com/qs/game/starter/IndexApi.java

3.52KB

qs-hadoop-elasticsearch-starter/src/test/java/com/qs/game/starter/TransportClientTest.java

58.29KB

qs-hadoop-elasticsearch-starter/src/test/resources/elasticsearch.properties

qs-hadoop-elasticsearch-starter/src/test/resources/log4j2.properties

179B

qs-hadoop-file/files/access.log

6.93MB

qs-hadoop-file/files/files.txt

68B

qs-hadoop-file/files/people.json

73B

qs-hadoop-file/files/people1.json

448B

qs-hadoop-file/files/salary.csv

398B

qs-hadoop-file/files/ShieldedWord.docx

62.87KB

qs-hadoop-file/files/storm_wc.txt

35B

qs-hadoop-file/files/student.data

2.14KB

qs-hadoop-file/files/users.parquet

615B

qs-hadoop-file/files/words.txt

96.38KB

qs-hadoop-file/files/aa.txt/.part-00000-830924cf-7d60-499f-9a13-7d3d9ca5d88c.csv.crc

12B

qs-hadoop-file/files/aa.txt/.part-00001-830924cf-7d60-499f-9a13-7d3d9ca5d88c.csv.crc

12B

qs-hadoop-file/files/aa.txt/._SUCCESS.crc

qs-hadoop-file/files/aa.txt/part-00000-830924cf-7d60-499f-9a13-7d3d9ca5d88c.csv

57B

qs-hadoop-file/files/aa.txt/part-00001-830924cf-7d60-499f-9a13-7d3d9ca5d88c.csv

19B

qs-hadoop-file/files/aa.txt/_SUCCESS

qs-hadoop-file/files/userLog/.part-00000-928fac94-5257-4047-b279-387344054d99.txt.crc

11.38KB

qs-hadoop-file/files/userLog/.part-00001-928fac94-5257-4047-b279-387344054d99.txt.crc

2.91KB

qs-hadoop-file/files/userLog/._SUCCESS.crc

qs-hadoop-file/files/userLog/part-00000-928fac94-5257-4047-b279-387344054d99.txt

1.42MB

qs-hadoop-file/files/userLog/part-00001-928fac94-5257-4047-b279-387344054d99.txt

370.85KB

qs-hadoop-file/files/userLog/_SUCCESS

qs-hadoop-file/images/hadoop-Ecosphere.png

461.31KB

qs-hadoop-file/images/hadoop.jpg

107.32KB

qs-hadoop-file/images/spark-Ecosphere.jpg

21.41KB

qs-hadoop-file/note/note1.txt

1.7KB

qs-hadoop-file/note/异常总结.txt

6.16KB

qs-hadoop-file/note/进度

614B

qs-hadoop-file/note/doc/1

8.01KB

qs-hadoop-file/note/doc/10

1.71KB

qs-hadoop-file/note/doc/2

465B

qs-hadoop-file/note/doc/3

1.75KB

qs-hadoop-file/note/doc/4

1.89KB

qs-hadoop-file/note/doc/5

3.15KB

qs-hadoop-file/note/doc/6

1.16KB

qs-hadoop-file/note/doc/7

2.71KB

qs-hadoop-file/note/doc/9

6.46KB

qs-hadoop-file/note/doc/FlumeUserGuide.pdf

1.25MB

qs-hadoop-file/note/doc/hadoop-spark-user.txt

864B

qs-hadoop-file/tools/hadoop-common-2.2.0-bin-master.zip

272.62KB

qs-hadoop-file/tools/Spark Streaming/project.zip

270.85KB

qs-hadoop-file/tools/userLog/project (1).zip

899.31KB

qs-hadoop-file/tools/userLog/project.zip

1.11MB

qs-hadoop-flink/pom.xml

1.18KB

qs-hadoop-flink/src/main/java/com/qs/flink/SocketWindowWordCount.java

3.13KB

qs-hadoop-hdfs/pom.xml

939B

qs-hadoop-hdfs/src/main/java/com/qs/hdfs/HdfsApp.java

3.32KB

qs-hadoop-ipParser/pom.xml

1.6KB

qs-hadoop-ipParser/README.md

969B

qs-hadoop-ipParser/src/main/java/com/ggstar/util/file/FileUtil.java

1.59KB

qs-hadoop-ipParser/src/main/java/com/ggstar/util/file/PoiUtil.java

656B

qs-hadoop-ipParser/src/main/java/com/ggstar/util/ip/IpHelper.java

3.07KB

qs-hadoop-ipParser/src/main/java/com/ggstar/util/ip/IpRelation.java

943B

qs-hadoop-ipParser/src/main/java/com/ggstar/util/ip/IpTree.java

5.72KB

qs-hadoop-ipParser/src/main/resources/ipDatabase.csv

4.75MB

qs-hadoop-ipParser/src/main/resources/ipRegion.xlsx

24.84KB

qs-hadoop-ipParser/src/main/resources/log4j2.xml

4.95KB

qs-hadoop-ipParser/src/test/java/com/ggstar/testclient/Client.java

348B

qs-hadoop-kafka/pom.xml

2.21KB

qs-hadoop-kafka/src/main/java/com/qs/game/KafkaConsumer.java

1.69KB

qs-hadoop-kafka/src/main/java/com/qs/game/KafkaProducer.java

1.2KB

qs-hadoop-kafka/src/main/java/com/qs/game/company/ConsumerDemo.java

3.02KB

qs-hadoop-kafka/src/main/java/com/qs/game/company/ProducerDemo.java

3.13KB

qs-hadoop-kafka/src/main/java/com/qs/game/conf/KafkaProperties.java

532B

qs-hadoop-kafka/src/main/java/com/qs/game/test/KafkaClientApp.java

372B

qs-hadoop-kafka/src/main/java/com/qs/game/test/KafkaProducerTest.java

542B

qs-hadoop-logger/pom.xml

1.97KB

qs-hadoop-logger/src/main/java/com/qs/game/LogerGenerater.java

530B

qs-hadoop-logger/src/main/java/com/qs/game/NginxAccessLogGenerater.java

5.33KB

qs-hadoop-logger/src/main/resources/log4j.properties

636B

qs-hadoop-mapreduce/pom.xml

944B

qs-hadoop-mapreduce/src/main/java/com/qs/mapreduce/MapReduce2App.java

4.99KB

qs-hadoop-mapreduce/src/main/java/com/qs/mapreduce/MapReduceApp.java

4.6KB

qs-hadoop-mapreduce/src/main/java/com/qs/mapreduce/MapReduceWithCombinerApp.java

5.27KB

qs-hadoop-mapreduce/src/main/java/com/qs/mapreduce/MapReduceWithPartitionerApp.java

5.79KB

qs-hadoop-mapreduce/src/main/resources/core-site.xml

412B

qs-hadoop-mapreduce/src/main/resources/hdfs-site.xml

285B

qs-hadoop-mapreduce/src/main/resources/log4j.properties

479B

qs-hadoop-mapreduce/src/main/resources/mapred-site.xml

280B

qs-hadoop-mapreduce/src/main/resources/yarn-site.xml

291B

qs-hadoop-spark/pom.xml

3.12KB

qs-hadoop-spark/src/main/java/com/qs/spark/JavaWordCount.java

1.9KB

qs-hadoop-spark/src/main/java/com/qs/spark/scala/SparkWordCount.scala

1.23KB

qs-hadoop-sparkSQL/pom.xml

4.72KB

qs-hadoop-sparkSQL/src/main/scala/com/qs/DataFrameApiApp.scala

4.29KB

qs-hadoop-sparkSQL/src/main/scala/com/qs/DataFrameApp.scala

2.11KB

qs-hadoop-sparkSQL/src/main/scala/com/qs/DataFrameRDDApp.scala

3.31KB

qs-hadoop-sparkSQL/src/main/scala/com/qs/DataSetApi.scala

1.4KB

qs-hadoop-sparkSQL/src/main/scala/com/qs/HiveContextApp.scala

1.22KB

qs-hadoop-sparkSQL/src/main/scala/com/qs/HiveMysqlApp.scala

926B

qs-hadoop-sparkSQL/src/main/scala/com/qs/OperationJdbcAPP.scala

2.73KB

qs-hadoop-sparkSQL/src/main/scala/com/qs/ParquetApp.scala

2.24KB

qs-hadoop-sparkSQL/src/main/scala/com/qs/SparkSessionApp.scala

926B

qs-hadoop-sparkSQL/src/main/scala/com/qs/SparkSQLThriftServerApp.scala

849B

qs-hadoop-sparkSQL/src/main/scala/com/qs/SQLContextApp.scala

1.61KB

qs-hadoop-sparkSQL/src/main/scala/com/qs/Write2HiveApp.scala

2.18KB

qs-hadoop-sparkSQL/src/main/scala/com/qs/json/HandleJsonApp.scala

3.25KB

qs-hadoop-sparkSQL/src/main/scala/com/qs/json/package.scala

145B

qs-hadoop-sparkSQL/src/test/scala/com/qs/ShieldedWordTest.scala

964B

qs-hadoop-sparkStream/.gitignore

370B

qs-hadoop-sparkStream/pom.xml

6.33KB

qs-hadoop-sparkStream/src/main/java/com/qs/game/LogerGenerater.java

564B

qs-hadoop-sparkStream/src/main/resources/log4j.properties

636B

qs-hadoop-sparkStream/src/main/scala/com/qs/App.scala

248B

qs-hadoop-sparkStream/src/main/scala/com/qs/game/FileWordCountStart01.scala

1.38KB

qs-hadoop-sparkStream/src/main/scala/com/qs/game/NetWordWordCountStart01.scala

949B

qs-hadoop-sparkStream/src/main/scala/com/qs/game/SqlNetworkWordCount05.scala

2.14KB

qs-hadoop-sparkStream/src/main/scala/com/qs/game/StatefulWordCountStart02.scala

1.66KB

qs-hadoop-sparkStream/src/main/scala/com/qs/game/TranFormApp04.scala

1.32KB

qs-hadoop-sparkStream/src/main/scala/com/qs/game/WordCount2MysqlStart03.scala

2.59KB

qs-hadoop-sparkStream/src/main/scala/com/qs/integration/FlumeIntegraStreamingPullApp.scala

2.8KB

qs-hadoop-sparkStream/src/main/scala/com/qs/integration/FlumeIntegraStreamingPushApp.scala

2.51KB

qs-hadoop-sparkStream/src/main/scala/com/qs/integration/KafkaIntegraStreamingDirectApp.scala

2.1KB

qs-hadoop-sparkStream/src/main/scala/com/qs/integration/KafkaIntegraStreamingReceiverApp.scala

1.83KB

qs-hadoop-sparkStream/src/main/scala/com/qs/integration/StreamingFlumeDirecKafkatApp.scala

2.16KB

qs-hadoop-sparkStream/src/main/scala/com/qs/integration/StreamingFlumeReceiverKafkaApp.scala

1.78KB

qs-hadoop-sparkStream-action/pom.xml

6.99KB

qs-hadoop-sparkStream-action/src/main/java/com/qs/utils/ConfigUtils.java

1.26KB

qs-hadoop-sparkStream-action/src/main/java/com/qs/utils/HBaseUtils.java

5.3KB

qs-hadoop-sparkStream-action/src/main/java/com/qs/utils/InterfaceUtils.java

2.14KB

qs-hadoop-sparkStream-action/src/main/resources/hadoop.properties

234B

qs-hadoop-sparkStream-action/src/main/scala/com/qs/App.scala

248B

qs-hadoop-sparkStream-action/src/main/scala/com/qs/dao/AccessLogDao.scala

2.69KB

qs-hadoop-sparkStream-action/src/main/scala/com/qs/dao/NginxAccessLogDao.scala

2.09KB

qs-hadoop-sparkStream-action/src/main/scala/com/qs/game/InterfaceAccessStatisticsApp.scala

3.15KB

qs-hadoop-sparkStream-action/src/main/scala/com/qs/game/NginxAccessStatisticsApp.scala

3.09KB

qs-hadoop-sparkStream-action/src/main/scala/com/qs/model/AccessLog.scala

162B

qs-hadoop-sparkStream-action/src/main/scala/com/qs/model/AccessSuccessLog.scala

169B

qs-hadoop-sparkStream-action/src/main/scala/com/qs/model/CountEntity.scala

193B

qs-hadoop-sparkStream-action/src/main/scala/com/qs/utils/DateUtils.scala

569B

qs-hadoop-sparkStream-action/src/test/java/samples/HBaseExample.java

3.39KB

qs-hadoop-sparkStream-action/src/test/java/samples/MyHbase.java

3.81KB

qs-hadoop-sparkStream-action/src/test/java/samples/Test01.java

446B

qs-hadoop-sparkStream-action/src/test/scala/samples/Test02.scala

165B

qs-hadoop-sparkStream-action/src/test/scala/samples/Test03.scala

311B

qs-hadoop-spring/pom.xml

1.36KB

qs-hadoop-spring/src/main/java/com/qs/spring/HDFSSpringTest.java

2.12KB

qs-hadoop-spring/src/main/resources/beans.xml

932B

qs-hadoop-spring/src/main/resources/hadoop.properties

26B

qs-hadoop-spring/src/test/java/com/qs/spring/Test01ConcurrentLinkedQueue.java

2.76KB

qs-hadoop-springboot/pom.xml

1.22KB

qs-hadoop-springboot/src/main/java/com/qs/springboot/HDFSSrpingBootApp.java

2.34KB

qs-hadoop-springboot/src/main/java/com/qs/springboot/hdfs/TestForHDFS.java

214B

qs-hadoop-springboot/src/main/resources/application.yml

80B

qs-hadoop-storm/pom.xml

2.83KB

qs-hadoop-storm/src/main/java/com/qs/App.java

169B

qs-hadoop-storm/src/main/java/com/qs/game/LocalSumStormTopology01.java

3.74KB

qs-hadoop-storm/src/main/java/com/qs/game/LocalWordCountStormTopology02.java

5.43KB

qs-hadoop-storm/src/test/java/com/qs/AppTest.java

278B

qs-hadoop-streaming-action-webUi/mvnw

6.32KB

qs-hadoop-streaming-action-webUi/mvnw.cmd

4.88KB

qs-hadoop-streaming-action-webUi/pom.xml

3.47KB

qs-hadoop-streaming-action-webUi/.mvn/wrapper/maven-wrapper.jar

46.49KB

qs-hadoop-streaming-action-webUi/.mvn/wrapper/maven-wrapper.properties

110B

qs-hadoop-streaming-action-webUi/src/main/java/com/qs/game/streaming/QshadoopstreamingactionwebuiApplication.java

369B

qs-hadoop-streaming-action-webUi/src/main/java/com/qs/game/streaming/controller/AccessLogController.java

1.59KB

qs-hadoop-streaming-action-webUi/src/main/java/com/qs/game/streaming/controller/IndexController.java

662B

qs-hadoop-streaming-action-webUi/src/main/java/com/qs/game/streaming/dao/AccessCountDao.java

1.27KB

qs-hadoop-streaming-action-webUi/src/main/java/com/qs/game/streaming/dao/AccessSuccessCountDao.java

1.36KB

qs-hadoop-streaming-action-webUi/src/main/java/com/qs/game/streaming/model/AccessCount.java

629B

qs-hadoop-streaming-action-webUi/src/main/java/com/qs/game/streaming/model/AccessSuccessCount.java

643B

qs-hadoop-streaming-action-webUi/src/main/java/com/qs/game/streaming/service/IAccessService.java

689B

qs-hadoop-streaming-action-webUi/src/main/java/com/qs/game/streaming/service/impl/AccessServiceImpl.java

1.05KB

qs-hadoop-streaming-action-webUi/src/main/java/com/qs/game/streaming/utils/HBaseUtils.java

6.84KB

qs-hadoop-streaming-action-webUi/src/main/java/com/qs/game/streaming/utils/InterfaceUtils.java

2.05KB

qs-hadoop-streaming-action-webUi/src/main/resources/application.yml

235B

qs-hadoop-streaming-action-webUi/src/main/resources/static/my.css

qs-hadoop-streaming-action-webUi/src/main/resources/static/css/my.css

qs-hadoop-streaming-action-webUi/src/main/resources/static/images/my.images

qs-hadoop-streaming-action-webUi/src/main/resources/static/js/echarts.min.js

701.81KB

qs-hadoop-streaming-action-webUi/src/main/resources/static/js/jquery-3.3.1.min.js

84.89KB

qs-hadoop-streaming-action-webUi/src/main/resources/static/js/my.js

qs-hadoop-streaming-action-webUi/src/main/resources/templates/dept.html

123B

qs-hadoop-streaming-action-webUi/src/main/resources/templates/echarts/index.html

3.17KB

qs-hadoop-streaming-action-webUi/src/main/resources/templates/echarts/index2.html

2.33KB

qs-hadoop-streaming-action-webUi/src/main/resources/templates/user/user.html

124B

qs-hadoop-streaming-action-webUi/src/test/java/com/qs/game/streaming/QshadoopstreamingactionwebuiApplicationTests.java

369B

qs-hadoop-userBehaviorLog/pom.xml

950B

qs-hadoop-userBehaviorLog/src/main/java/com/qs/user/NginxUserLog.java

6.48KB

qs-hadoop-userBehaviorLog/src/main/java/com/qs/user/source/Browser.java

3.2KB

qs-hadoop-userBehaviorLog/src/main/java/com/qs/user/source/BrowserVersion.java

1.5KB

qs-hadoop-userBehaviorLog/src/main/java/com/qs/user/source/Engine.java

1.35KB

qs-hadoop-userBehaviorLog/src/main/java/com/qs/user/source/OS.java

2.64KB

qs-hadoop-userBehaviorLog/src/main/java/com/qs/user/source/package-info.java

92B

qs-hadoop-userBehaviorLog/src/main/java/com/qs/user/source/Platform.java

2.25KB

qs-hadoop-userBehaviorLog/src/main/java/com/qs/user/source/UserAgent.java

1.45KB

qs-hadoop-userBehaviorLog/src/main/java/com/qs/user/source/UserAgentParser.java

9.98KB

qs-hadoop-userBehaviorLog/src/main/resources/core-site.xml

412B

qs-hadoop-userBehaviorLog/src/main/resources/hdfs-site.xml

285B

qs-hadoop-userBehaviorLog/src/main/resources/log4j.properties

479B

qs-hadoop-userBehaviorLog/src/main/resources/mapred-site.xml

280B

qs-hadoop-userBehaviorLog/src/main/resources/yarn-site.xml

291B

qs-hadoop-userBehaviorLog/src/test/java/UserAgentParserTest.java

2.68KB

qs-hadoop-userLog-scala/pom.xml

7.02KB

qs-hadoop-userLog-scala/src/main/scala/com/qs/log/clean/UserLogStatCleanJob.scala

4.52KB

qs-hadoop-userLog-scala/src/main/scala/com/qs/log/clean/UserLogStatCleanJob2.scala

6.41KB

qs-hadoop-userLog-scala/src/main/scala/com/qs/log/clean/UserLogStatCleanJob3.scala

3.73KB

qs-hadoop-userLog-scala/src/main/scala/com/qs/log/clean/UserLogStatFormatJob.scala

3.85KB

qs-hadoop-userLog-scala/src/main/scala/com/qs/log/dao/StatTopNDao.scala

4.76KB

qs-hadoop-userLog-scala/src/main/scala/com/qs/log/model/StatCityEntity.scala

119B

qs-hadoop-userLog-scala/src/main/scala/com/qs/log/model/StatEntity.scala

88B

qs-hadoop-userLog-scala/src/main/scala/com/qs/log/model/StatPTypeEntity.scala

90B

qs-hadoop-userLog-scala/src/main/scala/com/qs/log/topn/TopCityNStatJob.scala

4.34KB

qs-hadoop-userLog-scala/src/main/scala/com/qs/log/topn/TopNStatJob.scala

3.82KB

qs-hadoop-userLog-scala/src/main/scala/com/qs/log/topn/TopPlayTypeNStatJob.scala

2.71KB

qs-hadoop-userLog-scala/src/main/scala/com/qs/log/utils/DateUtils.scala

664B

qs-hadoop-userLog-scala/src/main/scala/com/qs/log/utils/MYSQLUtils.scala

787B

qs-hadoop-userLog-scala/src/main/scala/com/qs/log/yarn/UserLogStatCleanJob3Yarn.scala

4.01KB

qs-hadoop-webUi/pom.xml

3.3KB

qs-hadoop-webUi/src/main/java/com/qs/hadoop/dao/PlayTopNDao.java

1.86KB

qs-hadoop-webUi/src/main/java/com/qs/hadoop/model/PlayTopEntity.java

1.12KB

qs-hadoop-webUi/src/main/java/com/qs/hadoop/servlect/PlayTopNServlet.java

1.51KB

qs-hadoop-webUi/src/main/java/com/qs/hadoop/utils/MYSQLUtils.java

1.28KB

qs-hadoop-webUi/src/main/webapp/index.jsp

52B

qs-hadoop-webUi/src/main/webapp/statTop.html

2.83KB

qs-hadoop-webUi/src/main/webapp/js/echarts.min.js

701.81KB

qs-hadoop-webUi/src/main/webapp/js/jquery-3.3.1.min.js

84.89KB

qs-hadoop-webUi/src/main/webapp/WEB-INF/web.xml

469B

资源内容介绍

qs-hadoop此项目用于学习大数据hadoop生态圈以及storm、spark生态圈组织结构qs-hadoop├├── qs-hadoop-elasticsearch-springboot -- elasticsearch集成springboot以及基本使用|├── qs-hadoop-elasticsearch-starter -- elasticsearch开始使用|├── qs-hadoop-file -- 学习相关的资料文件、以及遇到的坑点笔记|├── qs-hadoop-flink -- 分布式数据流处理和批量数据处理框架 flink 初次见面|├── qs-hadoop-hdfs -- hadoop核心框架-分布式文件系统的java api的基本使用|├── qs-hadoop-ipParser -- 一个ip地址数据库，用于解析ip获取地址|├── qs-hadoop-kafka -- kafka生产者、消费者使用|├── qs-hadoop-logger -- 用于产生类似nginx访问日志的产生|├── qs-hado

## qs-hadoop 此项目用于学习大数据hadoop生态圈以及storm、spark生态圈 ![hadoop](qs-hadoop-file/images/hadoop.jpg)![hadoop-Ecosphere](qs-hadoop-file/images/hadoop-Ecosphere.png) ![spark-Ecosphere.jpg](qs-hadoop-file/images/spark-Ecosphere.jpg) ### 组织结构``` luaqs-hadoop├├── qs-hadoop-elasticsearch-springboot -- elasticsearch集成springboot以及基本使用|├── qs-hadoop-elasticsearch-starter -- elasticsearch开始使用|├── qs-hadoop-file -- 学习相关的资料文件、以及遇到的坑点笔记|├── qs-hadoop-flink -- 分布式数据流处理和批量数据处理框架 flink 初次见面|├── qs-hadoop-hdfs -- hadoop核心框架-分布式文件系统的java api的基本使用|├── qs-hadoop-ipParser -- 一个ip地址数据库，用于解析ip获取地址|├── qs-hadoop-kafka -- kafka生产者、消费者使用|├── qs-hadoop-logger -- 用于产生类似nginx访问日志的产生|├── qs-hadoop-mapreduce -- hadoop核心框架-分布式计算框架mapreduce java api编程实现|├── qs-hadoop-spark -- 基于sparkContext的wordcount Demo|├── qs-hadoop-sparkSQL -- 基于scala编程的spark核心dataset、dataframe的使用以及hive on spark等使用|├── qs-hadoop-sparkStream -- 基于scala编程的sparkstreaming是基本使用，分别集成flume、kafka日志收集|├── qs-hadoop-sparkStream-action -- 基于scala编程的sparkstreaming实战，集成flume、kafka做实时流处理的日志分析项目实战|├── qs-hadoop-streaming-action-webUi -- 基于java springboot编程的sparkstreaming实战数据图像化展示web ui界面(echarts)|├── qs-hadoop-userBehaviorLog -- 基于java编程的Mapreduce nginx日志用户行为离线处理分析,统计nginx用户访问日志的os个数|├── qs-hadoop-userLog-scala -- 基于scala编程的spark nginx日志用户行为离线处理分析|├── qs-hadoop-webUi -- 基于java servlet编程的spark nginx日志用户行为离线处理分析的数据图像化展示web ui界面(echarts)|├── qs-hadoop-spring -- HDFS集成java spring开源框架的基本使用|├── qs-hadoop-springboot -- HDFS集成java springboot开源框架的基本使用|├── qs-hadoop-storm -- storm实时流计算的使用``` ### 涉及到的编程语言及技术框架#### 编程语言- java 1.8.0_161- scala 2.11.12#### 技术框架及选型- hadoop 2.6.0 (cdh5.7.0)- spark 2.1.0 (cdh5.7.0)- flink 1.5.0 （cdh5.7.0）- flume 1.6.0 (cdh5.7.0)- kafka kafka_2.11-0.9.0.0- hbase 1.2.0 (cdh5.7.0)- elasticsearch 5.2.0- hive 1.1.0 (cdh5.7.0)- spring boot 2.0.3.RELEASE- echarts 3.3.1- zookeeper-3.4.5 (cdh5.7.0)- storm 1.1.2### 结束语> 本项目仅用于学习大数据生态圈使用，很多地方都是仅仅是demo形式，> 还有很多东西需要改进。> 项目随着学习进度持续更新...

用户评论 (0)

发表评论

您的昵称:

评分

评论内容:

验证码:

大数据生态圈学习.zip

资源文件列表(大概)

资源内容介绍

用户评论 (0)

发表评论

相关资源

CNG加气站设计本设计说明书共包括12个部分：在第一个部分主要介绍了压缩天然气加气站项目建设的背景、项目建设的必要性，第二部分主要对CNG加气站的气质参数具体分析与计算，得出了建CNG加气站的临界压

模块化多电平流器MMC 载波移相调制 Plecs 仿真工况：AC3.3kv DC6kv N=61仿真采用电压外环电流内环双闭环控制，输出电压能准确跟踪指令值 2采用均压控制保证各相

基于规则算法-功率跟随控制燃料电池汽车能量管理策略 advisor车辆数据电池SOC为电量维持型策略应用于nedc和udds工况，matlab 数据分析

基于规则算法-功率跟随控制燃料电池汽车能量管理策略 advisor车辆数据电池SOC为电量维持型策略应用于nedc和udds工况，matlab 数据分析

大数据生态圈学习.zip

资源文件列表(大概)

资源内容介绍

用户评论 (0)

发表评论

相关资源

CNG加气站设计本设计说明书共包括12个部分：在第一个部分主要介绍了压缩天然气加气站项目建设的背景、项目建设的必要性，第二部分主要对CNG加气站的气质参数具体分析与计算，得出了建CNG加气站的临界压

模块化多电平流器MMC 载波移相调制 Plecs 仿真工况 ：AC3.3kv DC6kv N=61仿真采用电压外环电流内环双闭环控制，输出电压能准确跟踪指令值 2采用均压控制保证各相

基于规则算法-功率跟随控制燃料电池汽车能量管理策略 advisor车辆数据 电池SOC为电量维持型策略 应用于nedc和udds工况，matlab 数据分析

基于规则算法-功率跟随控制燃料电池汽车能量管理策略 advisor车辆数据 电池SOC为电量维持型策略 应用于nedc和udds工况，matlab 数据分析

模块化多电平流器MMC 载波移相调制 Plecs 仿真工况：AC3.3kv DC6kv N=61仿真采用电压外环电流内环双闭环控制，输出电压能准确跟踪指令值 2采用均压控制保证各相

基于规则算法-功率跟随控制燃料电池汽车能量管理策略 advisor车辆数据电池SOC为电量维持型策略应用于nedc和udds工况，matlab 数据分析

基于规则算法-功率跟随控制燃料电池汽车能量管理策略 advisor车辆数据电池SOC为电量维持型策略应用于nedc和udds工况，matlab 数据分析