You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
analytics/lib/plausible_web/plugs
Adrian Gruntkowski f8b4d5066a
Add multiple imports per site (#3724)
* Clean up references to no longer active `google_analytics_imports` Oban queue

* Stub CSV importer

* Add SiteImport schema

* Rename `Plausible.Imported` module file to match module name

* Add `import_id` column to `Imported.*` CH schemas

* Implement Importer behavior and manage imports state using new entities

* Implement importer callbacks and maintain site.imported_data for UA

* Keep imports in sync when forgetting all imports

* Scope imported data queries to completed import IDs

* Mark newly imported data with respective import ID

* Clean up Importer implementation a bit

* Test querying legacy and new imported data

* Send Oban notifications on import worker failure too

* Fix checking for forgettable imports and remove redundant function

* Fix UA integration test

* Change site import source to atom enum and add source label

* Add typespecs and reduce repetition in `Plausible.Imported`

* Improve documentation and typespecs

* Add test for purging particular import

* Switch email notification templates depending on import source

* Document running import synchronously

* Fix UA importer args parsing and ensure it's covered by tests

* Clear `site.stats_start_date` on complete import to force recalculation

* Test Oban notifications (h/t @ruslandoga)

* Purge stats on import failure right away to reduce a chance of leaving debris behind

* Fix typos

Co-authored-by: hq1 <hq@mtod.org>

* Fix another typo

* Refactor fetching earliest import and earliest stats start date

* Use `Date.after?` instead of `Timex.after?`

* Cache import data in site virtual fields and limit queried imports to 5

* Ensure always current `stats_start_date` is used

* Work around broken typespec in Timex

* Make `SiteController.forget_imported` action idempotent

* Discard irrecoverably failed import tasks

* Use macros for site import statuses

There's also a fix ensuring only complete imports are considered
where relevant - couldn't isolate it as it was in a common hunk

* Use `import_id` as worker job uniqueness criterion

* Do not load imported stats data in plugins API context

---------

Co-authored-by: hq1 <hq@mtod.org>
3 years ago
..
auth_plug.ex [pg migration] Delete account with multiple subscriptions (#3220) 3 years ago
authorize_plugins_api.ex Track tokens usage (#3438) 3 years ago
authorize_site_access.ex Add multiple imports per site (#3724) 3 years ago
authorize_stats_api.ex Add multiple imports per site (#3724) 3 years ago
crm_auth_plug.ex Allow admin access to locked dashboards (#1710) 5 years ago
error_handler.ex Partially revert #3661 - just keep the real errors wrapped, but don't display anything to the user (#3677) 3 years ago
favicon.ex Escape domain when creating URL for favicon (#2942) 4 years ago
first_launch_plug.ex Remove custom domains support + update build options (#3559) 3 years ago
last_seen_plug.ex Formatting only changes - No code change (#75) 7 years ago
maybe_disable_registration.ex Remove custom domains support + update build options (#3559) 3 years ago
no_robots.ex Prevent robots from looking too much into public dashboards (#3118) 3 years ago
require_account.ex Trigger email reverification on change (#3388) 3 years ago
require_logged_out.ex Add elixir action (#526) 6 years ago
session_timeout_plug.ex Formatting only changes - No code change (#75) 7 years ago
tracker.ex Revenue tracking: goal conversions and tracker script (#3019) 3 years ago