paginate db result

Registered by Lianhao Lu

Instead of returning all the large amount of data as a whole from db, we need to paginate the return objects.

The sqlalchemy backend in oslo already has this kind of capability, so we need to rebase our sqlalchemy implementation on oslo's sqlalchemy to leverage that.

We also need to add this feature for mongoDB and HBase.

Blueprint information

Status:
Complete
Approver:
Julien Danjou
Priority:
Undefined
Drafter:
None
Direction:
Needs approval
Assignee:
Fengqian
Definition:
Obsolete
Series goal:
None
Implementation:
Blocked
Milestone target:
None
Started by
Fengqian
Completed by
gordon chung

Related branches

Sprints

Whiteboard

Gerrit topic: https://review.openstack.org/#q,topic:bp/paginate-db-search,n,z

Addressed by: https://review.openstack.org/35459
    Add pagination support for MongoDB

Addressed by: https://review.openstack.org/35454
    Add pagination support for sqlalchemy database

Addressed by: https://review.openstack.org/37454
    Add pagination support of API for database sqlalchemy and mongoDB.

Addressed by: https://review.openstack.org/41034
    Change the error message of resource listing in mongodb

Addressed by: https://review.openstack.org/41035
    Adjust some APIs' interface of hbase and logging storage backend

Addressed by: https://review.openstack.org/41129
    Change test_post_alarm case in test_alarm_scenarios

Addressed by: https://review.openstack.org/41130
    Change the default sort direction of mongodb to ascending

Addressed by: https://review.openstack.org/41869
    Change pagination query method in mongodb

Addressed by: https://review.openstack.org/42582
    Add pagination parameter to the base class of stroage

Addressed by: https://review.openstack.org/44278
    Add a fake UUID to Meter database model named meter_id

Addressed by: https://review.openstack.org/44492
    Add pagination query support for get_samples

Addressed by: https://review.openstack.org/44838
    Add next link in Meter/Sample/Resource/Alarm

Addressed by: https://review.openstack.org/45219
    Change test case get_alarm_history_on_create

marking obsolete, it seems pagination has become too controversial a topic. we will apply mandatory limits for now and revisit pagination work when we have proper buy in from community -- gordc (18.6.15)

(?)

Work Items

This blueprint contains Public information 
Everyone can see this information.