|
I am a big data development engineer. I received my B.Eng. in Software Engineering in 2021 from Hebei University of Engineering. |
|
|
I am interested in bid data systems and distributed systems. I am currently working as a Big Data Development Engineer at PayPal. Responsible for working with PayPal business units and product development teams. Design and develop data platforms and data solutions. I have the ability to build Data Lakehouse streaming and batching architecture with real business scenario experience. Experience in building storage-computation separation systems for cloud-native big data computing services. I have the ability to layer data warehouses and data governance in both offline and real-time environments, and have experience implementing SLA on data platforms. I have an understanding of JVM principles and experience in JVM tuning in large-memory, low-latency systems. Recently, I have been active in Iceberg community, participating in new feature design, bug fixing and answering user questions. |
|
|
|
paimon LSM Tree Java code Architecture overview, from SSTables, which are the disk-resident portion of the database, Skip Lists, used as memory buffers, and finally to the combination of the twos to create insertion, lookup and deletion primitives. |
|
Iceberg catalog prototype, snapshot version control Java implementation Serializable isolation -- Reads will be isolated from concurrent writes and always use a committed snapshot of a table’s data. Writes will support removing and adding files in a single operation and are never partially visible. Readers will not acquire locks. |
|
|
|
Big Data Developer Engineer | 06/2022 - present, Beijing, China 1. Collaborated with PayPal business units and product development teams to design, develop, and deliver data solutions on the data platform. 2. Provided business insights, predictive analytics, machine learning, and other data to data analysts and data scientists to support PayPal business units. 3. Responsible for designing and developing data solution features and data pipelines with high reliability, stability, scalability, and performance. |
|
Big Data Developer Engineer | 07/2021 - 05/2022, Beijing, China 1. Planned, designed, and built the business data architecture to drive business growth through data products and data services. 2. Developed and optimized offline and real-time data warehouses for the business, providing reliable and unified data services for higher-level analysis and exploration. 3. Provided customized data support to the business layer and optimized computational task performance to improve resource utilization efficiency. |
|
Template from jonbarron. |