Skip to content

gAmUssA/project-drift

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

DRIFT: Data Rides In Flink sTreams

Core Topics and Schemas

Vehicle Positions Topic
Topic: drift.vehicle.positions
Key: vehicleId (String)
Value Schema: io.confluent.developer.drift.schema.vehicle.VehiclePosition
Retention: 1 hour
Partitions: 12-24 (high throughput)
Compaction: true
Ride Requests Topic
Topic: drift.ride.requests
Key: requestId (String)
Value Schema: io.confluent.developer.drift.schema.ride.RideRequest
Retention: 24 hours
Partitions: 6-12
Compaction: true
Ride Matches Topic
Topic: drift.ride.matches
Key: matchId (String)
Value Schema: io.confluent.developer.drift.schema.ride.RideMatch
Retention: 24 hours
Partitions: 6-12
Compaction: true
Ride Statuses Topic
Topic: drift.ride.status
Key: rideId (String)
Value Schema: io.confluent.developer.drift.schema.ride.RideStatus
Retention: 24 hours
Partitions: 6-12
Compaction: true

Analytics Topics and Schemas

Vehicle Density Topic
Topic: drift.analytics.vehicle.density
Key: geohash (String)
Value Schema: io.confluent.developer.drift.schema.analytics.VehicleDensity
Retention: 1 hour
Partitions: 6
Matching Metrics Topic
Topic: drift.analytics.matching.metrics
Key: timeWindow (String)
Value Schema: io.confluent.developer.drift.schema.analytics.MatchingMetrics
Retention: 24 hours
Partitions: 6

System Topics

  1. Dead Letter Queue Topics

Topics:
* drift.dlq.vehicle.positions
* drift.dlq.ride.requests
* drift.dlq.ride.matches
Value Schema: io.confluent.developer.drift.schema.system.DeadLetterRecord

License

This project is licensed under the MIT License - see the LICENSE.txt file for details.

About

Data Rides In Flink sTreams

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •  

Languages