(Analytics) Regenerate analytics partitions only when dirty

Registered by Lars Helge Øverland on 2014-10-22

During a standard re-generation of analytics table partitions today, all partitions are re-generated indiscriminately. In order to reduce the amount of work, the system should recognize which partitions actually need to be refreshed. It no data has been altered then the analytics partition should not be re-generated. The system must store the timestamp of the last successful re-generation of each partition, and compare that to the last updated data value to the corresponding year. The last updated field should be fetched with a sql query against the datavalue table looking at the lastupdated column.

This blueprint depends on soft deletes of data values.

Blueprint information

Status:
Not started
Approver:
Lars Helge Øverland
Priority:
Medium
Drafter:
Lars Helge Øverland
Direction:
Approved
Assignee:
Lars Helge Øverland
Definition:
New
Series goal:
Accepted for trunk
Implementation:
Unknown
Milestone target:
None

Related branches

Sprints

Whiteboard

(?)

Work Items

This blueprint contains Public information 
Everyone can see this information.

Subscribers

No subscribers.