Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Think about cache #20

Open
leplatrem opened this issue Nov 9, 2012 · 2 comments
Open

Think about cache #20

leplatrem opened this issue Nov 9, 2012 · 2 comments
Labels
question

Comments

@leplatrem
Copy link
Collaborator

  • Last-modified header of source url ?
@AntoineCezar
Copy link
Contributor

using las-modified header will add some complexity.

  • does url has already been fetched ?
  • does the fetched version has last-modified ?
  • HEAD before GET to know last-modified
  • save file and save last-modified
  • find the corresponding converted file if exists

1srt method: use a database
2nd method: use url hashes + metadata file

@leplatrem
Copy link
Collaborator Author

A simple key-value store seems fine ? Like a JSON or a pickledb, since pyramid has no file-based cache backend of its own.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
question
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@AntoineCezar @leplatrem