Real adopter data was not readily available, so I created a small but consistent table of adopter personas. Using Python with Faker in Google Colab connected to Spark, I sampled attributes such as age, housing type, activity level, and prior pet ownership.
That work produced adopters_silver in Google Cloud Storage. In parallel, I loaded an existing dataset of adoptable pets, explored its schema, and confirmed it was stable enough to combine with the adopter table.
I generated training examples by cross-joining adopters and pets, scoring each pair with a rule-based function, and applying a threshold to label matches as good or bad. I prototyped the flow in a local notebook, then operationalised it in PairGCPLoad.py with pandas and Google Cloud Storage.
There were practical adaptations. Dataproc Serverless ran into CPU quota limits, so I pivoted to pandas and gcsfs for simpler I/O. I also adjusted the pairing script to handle missing fields, including removing weight-dependent features when the pet data did not include weight.