-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Store images pulled from iFramely in our own CDN #3450
Comments
It seems that it fixed itself after a few hours 🤷 maybe an intermittent issue with iframely |
It seems that TikTok's thumbnail URLs are IP-specific or something similar. Example: I don't think there's a good way to solve this; we can probably scrap TikTok ourselves, but I believe that's probably a stretch? But otherwise we need to hide TikTok thumbnails from emails, which sucks. unrelated: hotlinkingApparently we are doing something that iframely doesn't recommend
https://iframely.com/docs/links Even then, if we put a reverse proxy for it, it probably won't work, because the URL is likely locked to iframely's server's IPs. |
Took a quick look into scraping. I don't know how stable this would be, but it seems fairly trivial:
But then we would have to upload the cover somewhere.. and cache it.. 🤔 @jmduke would like your input in this |
Huh, fascinating. So for you https://buttondown.com/features/integrations/tiktok does not currently work? (It does on my end, which points to, as you say, some sort of IP/geo-based perms which makes sense because we're hitting a CDN.) In that case, I think we can combine this issue with the hotlinking guidance and just re-upload thumbnails to our own S3 bucket. |
Well, it is working now, lol... but yesterday, it looked like the first post. Maybe, instead, what's happening is that iframely is caching a thumbnail url that expires (but isn't IP-locked) and eventually refreshes it. That might be more likely. Either way, the un-hotlinking stuff should help prevent it in most cases. Should I do the reuploading stuff? I'm not familiar with how we do these kinds of things, especially because we really want to deduplicate stuff (and ideally store where we got it from.) |
Yup, that all tracks. I'd say feel free to leave it for now. I'll retitle this issue to reflect the scope creep and think a bit about the right way to approach it |
The text was updated successfully, but these errors were encountered: