400-060-0103

Hadoop大数据课程

Hadoop大数据课程

授课机构: 福州大数匠教育

上课地点: 校区地址

成交/评价:

联系电话: 400-060-0103

Hadoop大数据课程课程详情

Hadoop大数据开发实战课程大纲

本课程将让学员掌握 Hadoop 架构原理和 使用场景,通过项目实战锻炼,独立规划及部署生产环境的Hadoop集群,掌握Hadoop基本运维思路和方法,对Hadoop集群进行管理和优化,熟练使用Hadoop进行MapReduce程序开发。

技术储备阶段

Hadoop以及相关模块实操

Hadoop介绍

hadoop分为运维和开发:

运维一般是搭建集群环境,调优集群,集群良好运行;开发就是通过运行mapreduce等程序,让他完成我们想让hadoop集群完成的事情。

本章节将让学员了解Hadoop,把握分布式计算框架及未来发展方向,在大数据时代能为企业的技术选型及架构设计提供决策参考。

数据仓库HIVE

Hive是大数据开发的核心工具,本章详解数据仓库HIVE,让学员了解并掌握Hadoop的数据仓库原理和运行机制。

分布式数据库Hbase

Hadoop介绍

计算模型MapReduce

Spark项目入门与提高

分布式文件系统HDFS体系结构

分布式协作系统ZooKeeper

Scala介绍

Spark平台下的机器学习

Spark项目编译

Hbase是一个高可靠性、高性能、面向列、可伸缩的分布式存储系统,本章将详细讲解Hbase体系及存储机制

是一个用来将Hadoop和关系型数据库中的数据相互转移的工具,是不同类型数据库互操作的重要应用工具。

MapReduce能够让用户编写的Hadoop并行应用程序运行更加简化高效,本章节将让学员学习软件的执行原理,并通过实际编写练习掌握

MapReduce

是用来解决分布式应用中经常遇到的一些数据管理问题,简化分布式应用协调及其管理的难度,提供高性能的分布式服务;本章节将介绍ZooKeeper原理和基本操作。

Hadoop中的分布式文件系统HDFS能够实现数据在计算机集群组成的云上高效的存储和管理,是hadoop中核心体系,本章将让学员通过理论及实际操作了解HDFS的体系结构和操作规范。

Spark是应对实时查询和迭代计算的有力工具,本章帮助学员了解并掌握Spark的原理,开发环境的搭建,掌握各个算法的使用场景与适用范围

作为流计算技术中的佼佼者和主流的Storm被誉为实时版的Hadoop,本章节将详细介绍Storm,让学员了解并掌握分布式实时大数据处理工具, 弥补hadoop在实时数据上的不足。

Spark在机器学习方面有着得天独厚的优势,特别适合需要多次迭代计算的算法。

Scala在大数据,云计算方面有较为广泛的运用,而且由于Spark是由Scala语言开发的,所以大家在开发Spark应用程序时,Scala成为必学语言之一。

Hadoop项目实战

行业案例实战

通过真实企业案例,让学员从理论到实践上都能掌握大数据企业开发必备技能,为打下坚实理论与实战基础。

福州大数匠教育

福州大数匠教育
认证 7 年

成立: 2006年

认证 地址认证 教学保障 在线预约 到店体验 售后支持
基本 文件 流程 错误 SQL 调试
  1. 请求信息 : 2026-06-03 08:30:41 HTTP/1.1 GET : http://www.eduml.com/s/18619/c/184111.html
  2. 运行时间 : 0.041086s [ 吞吐率:24.34req/s ] 内存消耗:351.98kb 文件加载:136
  3. 缓存信息 : 0 reads,0 writes
  1. /data/web/baijiao_branch_collect/public/index.php ( 0.79 KB )
  2. /data/web/baijiao_branch_collect/vendor/autoload.php ( 0.75 KB )
  3. /data/web/baijiao_branch_collect/vendor/composer/autoload_real.php ( 1.63 KB )
  4. /data/web/baijiao_branch_collect/vendor/composer/platform_check.php ( 0.90 KB )
  5. /data/web/baijiao_branch_collect/vendor/composer/ClassLoader.php ( 15.99 KB )
  6. /data/web/baijiao_branch_collect/vendor/composer/autoload_static.php ( 4.26 KB )
  7. /data/web/baijiao_branch_collect/vendor/topthink/think-helper/src/helper.php ( 8.34 KB )
  8. /data/web/baijiao_branch_collect/vendor/topthink/think-validate/src/helper.php ( 2.19 KB )
  9. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/helper.php ( 1.47 KB )
  10. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/stubs/load_stubs.php ( 0.16 KB )
  11. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/Exception.php ( 1.69 KB )
  12. /data/web/baijiao_branch_collect/vendor/topthink/think-container/src/Facade.php ( 2.71 KB )
  13. /data/web/baijiao_branch_collect/vendor/symfony/deprecation-contracts/function.php ( 0.99 KB )
  14. /data/web/baijiao_branch_collect/vendor/symfony/polyfill-mbstring/bootstrap.php ( 8.26 KB )
  15. /data/web/baijiao_branch_collect/vendor/symfony/polyfill-mbstring/bootstrap80.php ( 9.78 KB )
  16. /data/web/baijiao_branch_collect/vendor/symfony/var-dumper/Resources/functions/dump.php ( 1.49 KB )
  17. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/App.php ( 15.30 KB )
  18. /data/web/baijiao_branch_collect/vendor/topthink/think-container/src/Container.php ( 15.76 KB )
  19. /data/web/baijiao_branch_collect/vendor/psr/container/src/ContainerInterface.php ( 1.02 KB )
  20. /data/web/baijiao_branch_collect/app/provider.php ( 0.19 KB )
  21. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/Http.php ( 6.04 KB )
  22. /data/web/baijiao_branch_collect/vendor/topthink/think-helper/src/helper/Str.php ( 7.29 KB )
  23. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/Env.php ( 4.68 KB )
  24. /data/web/baijiao_branch_collect/app/common.php ( 10.83 KB )
  25. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/helper.php ( 18.78 KB )
  26. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/Config.php ( 5.54 KB )
  27. /data/web/baijiao_branch_collect/config/app.php ( 1.29 KB )
  28. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/facade/Env.php ( 1.67 KB )
  29. /data/web/baijiao_branch_collect/config/cache.php ( 1.22 KB )
  30. /data/web/baijiao_branch_collect/config/config.php ( 0.26 KB )
  31. /data/web/baijiao_branch_collect/config/console.php ( 0.29 KB )
  32. /data/web/baijiao_branch_collect/config/cookie.php ( 0.56 KB )
  33. /data/web/baijiao_branch_collect/config/database.php ( 2.29 KB )
  34. /data/web/baijiao_branch_collect/config/filesystem.php ( 0.63 KB )
  35. /data/web/baijiao_branch_collect/config/lang.php ( 0.81 KB )
  36. /data/web/baijiao_branch_collect/config/log.php ( 1.37 KB )
  37. /data/web/baijiao_branch_collect/config/middleware.php ( 0.19 KB )
  38. /data/web/baijiao_branch_collect/config/route.php ( 1.54 KB )
  39. /data/web/baijiao_branch_collect/config/session.php ( 0.57 KB )
  40. /data/web/baijiao_branch_collect/config/trace.php ( 0.34 KB )
  41. /data/web/baijiao_branch_collect/config/view.php ( 0.81 KB )
  42. /data/web/baijiao_branch_collect/app/event.php ( 0.25 KB )
  43. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/Event.php ( 7.67 KB )
  44. /data/web/baijiao_branch_collect/app/service.php ( 0.13 KB )
  45. /data/web/baijiao_branch_collect/app/AppService.php ( 0.26 KB )
  46. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/Service.php ( 1.64 KB )
  47. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/Lang.php ( 7.35 KB )
  48. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/lang/zh-cn.php ( 13.70 KB )
  49. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/initializer/Error.php ( 3.31 KB )
  50. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/initializer/RegisterService.php ( 1.33 KB )
  51. /data/web/baijiao_branch_collect/vendor/services.php ( 0.14 KB )
  52. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/service/PaginatorService.php ( 1.52 KB )
  53. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/service/ValidateService.php ( 0.99 KB )
  54. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/service/ModelService.php ( 2.04 KB )
  55. /data/web/baijiao_branch_collect/vendor/topthink/think-trace/src/Service.php ( 0.77 KB )
  56. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/Middleware.php ( 6.72 KB )
  57. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/initializer/BootService.php ( 0.77 KB )
  58. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/Paginator.php ( 11.86 KB )
  59. /data/web/baijiao_branch_collect/vendor/topthink/think-validate/src/Validate.php ( 63.20 KB )
  60. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/Model.php ( 23.55 KB )
  61. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/model/concern/Attribute.php ( 21.05 KB )
  62. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/model/concern/AutoWriteData.php ( 4.20 KB )
  63. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/model/concern/Conversion.php ( 6.75 KB )
  64. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/model/concern/DbConnect.php ( 5.16 KB )
  65. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/model/concern/ModelEvent.php ( 2.33 KB )
  66. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/model/concern/RelationShip.php ( 28.30 KB )
  67. /data/web/baijiao_branch_collect/vendor/topthink/think-helper/src/contract/Arrayable.php ( 0.09 KB )
  68. /data/web/baijiao_branch_collect/vendor/topthink/think-helper/src/contract/Jsonable.php ( 0.13 KB )
  69. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/model/contract/Modelable.php ( 0.09 KB )
  70. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/Db.php ( 2.88 KB )
  71. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/DbManager.php ( 8.52 KB )
  72. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/Log.php ( 6.28 KB )
  73. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/Manager.php ( 3.92 KB )
  74. /data/web/baijiao_branch_collect/vendor/psr/log/src/LoggerTrait.php ( 2.69 KB )
  75. /data/web/baijiao_branch_collect/vendor/psr/log/src/LoggerInterface.php ( 2.71 KB )
  76. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/Cache.php ( 4.92 KB )
  77. /data/web/baijiao_branch_collect/vendor/psr/simple-cache/src/CacheInterface.php ( 4.71 KB )
  78. /data/web/baijiao_branch_collect/vendor/topthink/think-helper/src/helper/Arr.php ( 17.45 KB )
  79. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/cache/driver/Redis.php ( 6.94 KB )
  80. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/cache/Driver.php ( 9.03 KB )
  81. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/contract/CacheHandlerInterface.php ( 1.99 KB )
  82. /data/web/baijiao_branch_collect/app/Request.php ( 0.09 KB )
  83. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/Request.php ( 55.78 KB )
  84. /data/web/baijiao_branch_collect/app/middleware.php ( 0.26 KB )
  85. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/Pipeline.php ( 2.61 KB )
  86. /data/web/baijiao_branch_collect/vendor/topthink/think-trace/src/TraceDebug.php ( 3.40 KB )
  87. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/Route.php ( 23.73 KB )
  88. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/route/RuleName.php ( 5.75 KB )
  89. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/route/Domain.php ( 2.53 KB )
  90. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/route/RuleGroup.php ( 22.43 KB )
  91. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/route/Rule.php ( 26.95 KB )
  92. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/route/RuleItem.php ( 9.78 KB )
  93. /data/web/baijiao_branch_collect/route/app.php ( 3.05 KB )
  94. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/facade/Route.php ( 4.70 KB )
  95. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/route/dispatch/Controller.php ( 4.74 KB )
  96. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/route/Dispatch.php ( 10.44 KB )
  97. /data/web/baijiao_branch_collect/app/controller/Index.php ( 33.26 KB )
  98. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/facade/Request.php ( 9.20 KB )
  99. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/route/Url.php ( 14.07 KB )
  100. /data/web/baijiao_branch_collect/app/model/IndexModel.php ( 19.95 KB )
  101. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/facade/Config.php ( 1.37 KB )
  102. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/facade/Cache.php ( 2.06 KB )
  103. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/facade/Db.php ( 0.93 KB )
  104. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/db/connector/Mysql.php ( 5.73 KB )
  105. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/db/PDOConnection.php ( 53.74 KB )
  106. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/db/Connection.php ( 8.39 KB )
  107. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/db/ConnectionInterface.php ( 4.57 KB )
  108. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/db/builder/Mysql.php ( 16.58 KB )
  109. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/db/Builder.php ( 24.07 KB )
  110. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/db/BaseBuilder.php ( 27.50 KB )
  111. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/db/Query.php ( 15.97 KB )
  112. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/db/BaseQuery.php ( 45.13 KB )
  113. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/db/concern/TimeFieldQuery.php ( 7.43 KB )
  114. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/db/concern/AggregateQuery.php ( 3.26 KB )
  115. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/db/concern/ModelRelationQuery.php ( 20.07 KB )
  116. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/db/concern/ParamsBind.php ( 3.66 KB )
  117. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/db/concern/ResultOperation.php ( 7.01 KB )
  118. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/db/concern/WhereQuery.php ( 19.37 KB )
  119. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/db/concern/JoinAndViewQuery.php ( 7.11 KB )
  120. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/db/concern/TableFieldInfo.php ( 2.63 KB )
  121. /data/web/baijiao_branch_collect/vendor/topthink/think-orm/src/db/concern/Transaction.php ( 2.77 KB )
  122. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/log/driver/File.php ( 5.96 KB )
  123. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/contract/LogHandlerInterface.php ( 0.86 KB )
  124. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/log/Channel.php ( 3.89 KB )
  125. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/event/LogRecord.php ( 1.02 KB )
  126. /data/web/baijiao_branch_collect/vendor/topthink/think-helper/src/Collection.php ( 16.47 KB )
  127. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/Response.php ( 8.81 KB )
  128. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/response/View.php ( 3.29 KB )
  129. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/Cookie.php ( 6.06 KB )
  130. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/View.php ( 4.39 KB )
  131. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/view/driver/Php.php ( 6.44 KB )
  132. /data/web/baijiao_branch_collect/vendor/topthink/framework/src/think/contract/TemplateHandlerInterface.php ( 1.60 KB )
  133. /data/web/baijiao_branch_collect/view/index/pc/school_course_details.php ( 6.12 KB )
  134. /data/web/baijiao_branch_collect/view/index/pc/school_top.php ( 5.76 KB )
  135. /data/web/baijiao_branch_collect/view/index/pc/school_bottom.php ( 1.16 KB )
  136. /data/web/baijiao_branch_collect/vendor/topthink/think-trace/src/Html.php ( 4.42 KB )
  1. CONNECT:[ UseTime:0.000324s ] mysql:host=127.0.0.1;port=3306;dbname=baijiao_branch_collect;charset=utf8
  2. SHOW FULL COLUMNS FROM `fqi_school` [ RunTime:0.000845s ]
  3. SELECT * FROM `fqi_school` WHERE `school_id` = '18619' AND `site_id` = 7 AND `school_status` = 1 LIMIT 1 [ RunTime:0.000257s ]
  4. SHOW FULL COLUMNS FROM `fqi_school_class` [ RunTime:0.000555s ]
  5. SELECT * FROM `fqi_school_class` WHERE `school_id` = 18619 [ RunTime:0.000198s ]
  6. SHOW FULL COLUMNS FROM `fqi_school_campus` [ RunTime:0.000615s ]
  7. SELECT * FROM `fqi_school_campus` WHERE `school_id` = 18619 [ RunTime:0.000237s ]
  8. SHOW FULL COLUMNS FROM `fqi_school_course` [ RunTime:0.000655s ]
  9. SELECT `a`.*,`content` FROM `fqi_school_course` `a` LEFT JOIN `fqi_school_course_content` `b` ON `b`.`content_id`=`a`.`content_id` WHERE `school_id` = 18619 AND `a`.`content_id` = '184111' AND `course_status` = 1 AND `school_status` = 1 LIMIT 1 [ RunTime:0.000283s ]
  10. (select content_id,course_name from fqi_school_course where school_id = '18619' and content_id < '184111' and site_id = '7' order by content_id desc limit 1) union all(select content_id,course_name from fqi_school_course where school_id = '18619' and content_id > '184111' and site_id <= '7' order by content_id asc limit 1) [ RunTime:0.000477s ]
  11. SELECT * FROM `fqi_school_course` WHERE `school_id` = 18619 AND `site_id` = 7 AND `course_status` = 1 AND `school_status` = 1 AND `school_class_id` = 36471 ORDER BY `course_id` DESC LIMIT 4 [ RunTime:0.000237s ]
  12. SELECT * FROM `fqi_school_course` WHERE `school_id` = 18619 AND `site_id` = 7 AND `course_status` = 1 AND `school_status` = 1 ORDER BY `course_id` DESC LIMIT 10 [ RunTime:0.000246s ]
  13. SELECT COUNT(*) AS think_count FROM `fqi_school_course` WHERE `school_id` = 18619 AND `course_status` = 1 [ RunTime:0.000183s ]
  14. SHOW FULL COLUMNS FROM `fqi_school_teacher` [ RunTime:0.000591s ]
  15. SELECT COUNT(*) AS think_count FROM `fqi_school_teacher` WHERE `school_id` = '18619' [ RunTime:0.000172s ]
  16. SHOW FULL COLUMNS FROM `fqi_school_comments` [ RunTime:0.000563s ]
  17. SELECT COUNT(*) AS think_count FROM `fqi_school_comments` WHERE `school_id` = '18619' [ RunTime:0.000180s ]
  18. SELECT `content_id`,`course_name`,`a`.`school_id`,`b`.`school_name` FROM `fqi_school_course` `a` LEFT JOIN `fqi_school` `b` ON `b`.`school_id`=`a`.`school_id` WHERE `a`.`site_id` = '7' AND `b`.`school_status` = '1' AND `course_status` = 1 AND `course_id` < '184111' ORDER BY `content_id` DESC LIMIT 20 [ RunTime:0.030961s ]
0.041382s