作者：(美)乔·里斯(Joe Reis)，(美
页数：19,422页
出版社：东南大学出版社
出版日期：2023
ISBN：9787576605518
电子书格式：pdf/epub/txt
内容简介
数据工程在过去十年间发展迅速，许多软件工程师、数据科学家和分析师都在寻找相关实践的全面观点。通过这本实践用书，你将学习如何通过评估数据工程生命周期框架中可用的最佳技术来规划和构建系统，以满足你的组织和客户的需求。作者Joe Reis和Matt Housley将为你介绍数据工程的生命周期，向你展示如何综合运用各种云技术，以满足下游数据消费者的需求。你将理解如何应用数据生成、摄取、编排、转换、存储和治理的概念，无论底层技术是什么，这些概念在任何数据环境中都至关重要。
目录
Preface.
Part Ⅰ. Foundation and Building Blocks
1. Data Engineering Described..
What Is Data Engineering?
Data Engineering Defined
The Data Engineering Lifecycle
Evolution of the Data Engineer
Data Engineering and Data Science
Data Engineering Skills and Activities
Data Maturity and the Data Engineer
The Background and Skills of a Data Engineer
Business Responsibilities
Technical Responsibilities
The Continuum of Data Engineering Roles, from A to B
Data Engineers Inside an Organization
Internal-Facing Versus External-Facing Data Engineers
Data Engineers and Other Technical Roles
Data Engineers and Business Leadership
Conclusion
Additional Resources
2. The Data Engineering Lifecycle..
What Is the Data Engineering Lifecycle?
The Data Lifecycle Versus the Data Engineering Lifecycle
Generation: Source Systems
Storage
Ingestion
Transformation
Serving Data
Major Undercurrents Across the Data Engineering Lifecycle
Security
Data Management
DataOps
Data Architecture
Orchestration
Software Engineering
Conclusion
Additional Resources
3. Designing Good Data Architecture..
What Is Data Architecture?
Enterprise Architecture Defined
Data Architecture Defined
……
Part Ⅰ. Foundation and Building Blocks
1. Data Engineering Described..
What Is Data Engineering?
Data Engineering Defined
The Data Engineering Lifecycle
Evolution of the Data Engineer
Data Engineering and Data Science
Data Engineering Skills and Activities
Data Maturity and the Data Engineer
The Background and Skills of a Data Engineer
Business Responsibilities
Technical Responsibilities
The Continuum of Data Engineering Roles, from A to B
Data Engineers Inside an Organization
Internal-Facing Versus External-Facing Data Engineers
Data Engineers and Other Technical Roles
Data Engineers and Business Leadership
Conclusion
Additional Resources
2. The Data Engineering Lifecycle..
What Is the Data Engineering Lifecycle?
The Data Lifecycle Versus the Data Engineering Lifecycle
Generation: Source Systems
Storage
Ingestion
Transformation
Serving Data
Major Undercurrents Across the Data Engineering Lifecycle
Security
Data Management
DataOps
Data Architecture
Orchestration
Software Engineering
Conclusion
Additional Resources
3. Designing Good Data Architecture..
What Is Data Architecture?
Enterprise Architecture Defined
Data Architecture Defined
……
