Skip to content

GitLab

  • Menu
Projects Groups Snippets
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
  • logilab-database logilab-database
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 0
    • Issues 0
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages & Registries
    • Packages & Registries
    • Container Registry
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • open-source
  • logilab-databaselogilab-database
  • Merge requests
  • !6

WIP: [fix] avoid MemoryError by not fetching ALL results at once

  • Review changes

  • Download
  • Email patches
  • Plain diff
Merged Laurent Peuch requested to merge topic/default/small-db-optimization into branch/default May 13, 2020
  • Overview 0
  • Commits 1
  • Pipelines 2
  • Changes 1

I was working with Katia on memory optimization for FranceArchives and the MemoryError ended up being raised on this line because of the buffering.

So I wrote this small optmization, it helps but it's not enough because we have buffering higher in the call stack but it doesn't hurt.

I'm putting this in WIP because I'm not 100% sure it's fine but I guess so?

Assignee
Assign to
Reviewer
Request review from
Time tracking
Source branch: topic/default/small-db-optimization