For those watching development from afar, tonight’s update:
Started work on the new ingest queue. The old one turned into a classic pancake of adding just one more thing until it a little bit obnoxious. Rather than continuing to add to it, I’d rather clean up now and move to the new one.
It’s not yet feature-parity with the original ones (feed items are the biggest thing lost) but will definitely be equal in the coming days.
The new ingest is also using the new email engine I mentioned earlier and a new transaction matching system. This changes the format of the receipt a little, but means that a single email can be turned into multiple receipts and be matched to multiple or a single transaction.
This is necessary for Amazon who may send an email with two orders in and collect them as a single transaction, or indeed as two separate transactions on two different days etc.
tl;dr made a new thing, it’s better.
Also I’ve had a couple people DM and ask why I’m not adding merchant {x}. I very much will get to a point (hopefully by next week) where I can add merchants consistently. At the moment it’s more beneficial to strengthen the foundations and systems to make sure when I add more merchants I’m not causing myself more headaches.
Had family over tonight so because I love them very much I spent time with them I took it easy and worked on adding a handful of merchants (easier to stop/start)
So… today we have added support for:
eBay
Crowdcube
Coinbase
Stagecoach
PayPal Direct Debits
AtHand
Ritual
Uber Eats
McDonalds
iCloud
iTunes
With the exception of JustEat which I only just remembered exists while I’m writing this, that ticks off the higher priority food merchants as well adding support for a couple others!
These have all been built on top of the new email handler I mentioned in previous comments making it easier to add and update new merchants! (Some of these are just a couple lines of code! )
This brings up the number of supported merchants to 26
Great to have iTunes added! Amazing work on this and the speed of development is impressive. Whilst I know plans change, are your plans to move the new system to the default system whereby we send emails to receipts+ instead of experimental+?
Just wondering if it’s worth setting up automatic forwarding to the experimental address was all, if that’s even possible with the token actually
As soon as the new system has feature parity with the old one (and I’m happy it all works), it will become the default one - yes. This is why I’ve not encouraged people to move over.
My goal is still to have that done this week.
To be clear, experimental+ is temporary and will go away very soon.
If you want to talk about specific issues then please DM me and I can help you get it fixed. but in respect to the most recent Amazon order, it failed because it was a plain-text Amazon format which isn’t (currently) supported.
You can change your preferences about which type of Amazon email you get in the account settings on Amazon. We may look to support these plain-text formats in the future though.
Worth noting that (since records began, 4 days ago) each day has gotten better and better in terms of success rate. (This is mostly down to people using the new engine detailed above).
I’ve been a little bit quiet, but what’s been happening?
I spent some time refining some of our existing merchants especially PayPal and Amazon but also some of the others too. I fixed issues with surge pricing on Uber, restaurant names on AtHand and Deliveroo, added support for a real edge case with gift cards, and solved a weird formatting problem with some Domino’s orders.
I’ve added initial support for plain-text Amazon orders.
I’ve added support for feed items for email forwarding confirmation codes. This was after feedback that it was hard to find within the account page and people expected it in their feed. (Both are now supported)
I’ve re-added support for success and failure feed items to the new ingest, finally closing the gap between the two systems.
Full testing has now begun on the new system to ensure we have no regressions and functionally everything is still working. Assuming nothing goes horrendously wrong, we’ll be looking to onboard more testers in the next couple days!
Here’s also a picture of a small prototype I did at 4am this morning It’s clearly not perfect, and needs a lot of work - but it’s progress…
This project may start with email receipts, but that’s not where I want to stop
Anybody who joined the waitlist before 5pm today has also now been whitelisted
If anybody has any troubles, message me privately and I can give you the help you need!
If you haven’t received an email, please check your spam/junk (especially hotmail users, not had any issues with Gmail yet!). If you still can’t find any email, and you joined the whitelist, also message me and I’ll give you the details you need.
Thanks for adding me, @Sherlock I’ve just started having a play and I’m really impressed with how this is working so far! The feed items are a nice touch too