Analytics Open Tasks

Help.

130651 EventStreams Backlog 2017-01-02 2017-07-10
154090 Add "Interwicket" to the list of bots Backlog 2017-04-02 2017-03-01
132256 Analytics hosts showed high temperature alarms Backlog 2017-04-02 2017-10-06
159337 Automate refinery jar cleanup Backlog 2017-04-02 2017-08-28
156384 Backend for wikistats 2.0 Backlog 2017-04-02 2017-07-17
136858 Beeline does not print full stack traces when a query fails {hawk} Backlog 2017-04-02 2017-10-31
114124 --- DISCUSSED BELOW --- Backlog 2017-04-02 2017-10-06
121561 Encrypt Kafka traffic, and restrict access via ACLs Backlog 2017-04-02 2017-08-09
160822 Filter local IPs before checking for geo info Backlog 2017-04-02 2017-10-23
159170 Find an alternative query interface for eventlogging on analytics cluster that can replace MariaDB Backlog 2017-04-02 2017-11-08
156933 Improve purging for analytics-slave data on Eventlogging Backlog 2017-04-02 2017-11-20
160370 Initial Launch of new Wikistats 2.0 website Backlog 2017-04-02 2017-05-02
117945 Investigate anomalous views to pages with replacement characters Backlog 2017-04-02 2017-10-23
135251 Investigate requests flagged as pageview in analytics header coming from bots Backlog 2017-04-02 2017-06-15
158334 Make Spark 2.1 easily available on new CDH5.10 cluster Backlog 2017-04-02 2017-11-14
155497 Measure Community Backlog. Backlog 2017-04-02 2017-07-17
155507 Meta-statistics on MediaWiki history reconstruction process Backlog 2017-04-02 2017-08-28
143927 Per Family Unique Devices Counts Backlog 2017-04-02 2017-05-05
152015 Provision new Kafka cluster(s) with security features Backlog 2017-04-02 2017-11-15
143924 Replacing standard edit metrics in dashiki with data from new edit data depot Backlog 2017-04-02 2016-12-21
114675 Sanitize pageview_hourly - subtasked {mole} Backlog 2017-04-02 2016-04-21
130256 Wikistats 2.0. Backlog 2017-04-02 2017-07-12
162610 Implement EventLogging Hive refinement Backlog 2017-04-11 2017-11-02
163817 Implement pageview metric in Wikistats UI Backlog 2017-04-26 2017-06-12
164020 Use hive dynamic partitioning to split webrequest on tags Backlog 2017-04-28 2017-09-12
164019 Webrequest tagging and distribution. Measuring non-pageview requests Backlog 2017-04-28 2017-06-27
164243 Alarms on pageview API latency increase Backlog 2017-05-03 2017-10-06
164348 Investigate the use of local_quorum for AQS Backlog 2017-05-04 2017-11-17
164593 Provide unqiues estimate/offset breakdowns in AQS Backlog 2017-05-06 2017-11-06
165309 Create small sample mediawiki-history table in MariaDB Backlog 2017-05-16 2017-10-13
166167 Write generic certificate management software for use with Puppet and Self Signing CAs. Backlog 2017-05-24 2017-11-20
167033 https://dumps.wikimedia.org/other/pageviews/ needs a README Backlog 2017-06-06 2017-10-06
167539 Final steps to expose project family unique devices data Backlog 2017-06-10 2017-10-03
167790 Refactor puppet code for the Hadoop Analytics cluster to roles/profiles Backlog 2017-06-14 2017-10-05
168477 Update html language for per-domain uniques Backlog 2017-06-21 2017-10-03
168550 Make tranquility work with Spark Backlog 2017-06-22 2017-10-05
169550 Final Vetting of Family Wide unique devices data Backlog 2017-07-04 2017-09-14
169572 Push mediawiki history data into labs. Public history data lake Backlog 2017-07-04 2017-09-01
169674 Fix EventLogging editCountBucket fields historically Backlog 2017-07-05 2017-10-19
170460 Wikistats 2.0 UI second deployment/iteration Backlog 2017-07-13 2017-07-18
170764 Migrate table creation query to oozie for interlanguage links Backlog 2017-07-17 2017-11-17
171099 CamusPartitionChecker does not work when topic names have '.' or '-' in them. Backlog 2017-07-20 2017-09-28
171923 thorium - failed git clone of geowiki-data-private Backlog 2017-07-29 2017-08-04
174110 Private data access for non-person user that calculates metrics Backlog 2017-08-25 2017-11-20
174493 Alerts for common/important EventStreams topic volume Backlog 2017-08-30 2017-08-31
174465 Puppet admin module should support adding system users to managed groups Backlog 2017-08-30 2017-11-21
174742 deployment-kafka01 - disk is full Backlog 2017-09-01 2017-10-02
174815 Schema:Popups suddenly stopped logging events in MariaDB, but they are still being sent according to Grafana Backlog 2017-09-02 2017-11-21
175422 Design map visualization on UI Backlog 2017-09-09 2017-11-21
175461 Port Clients to new jumbo cluster Backlog 2017-09-11 2017-10-26
175604 Order hardware labs storage for mediawiki history analytics friendly DB Backlog 2017-09-12 2017-09-21
175603 Procure hardware to refresh jupyter notebooks Backlog 2017-09-12 2017-09-21
175844 Provide oozie job running ClickStream spark job regularly Backlog 2017-09-14 2017-11-20
176223 Create Druid public cluster such AQS can query druid public data Backlog 2017-09-23 2017-11-21
176785 Add action api counts to graphite-restbase job Backlog 2017-09-27 2017-11-21
176983 Productionize streaming jobs Backlog 2017-09-29 2017-09-28
177408 Easter Egg: wikistats classic style on wikistats 2.0 Backlog 2017-10-05 2017-10-31
177459 Add a prometheus metric exporter to all the Druid daemons Backlog 2017-10-06 2017-11-17
177491 Alert user about adblocker preventing AQS requests Backlog 2017-10-06 2017-11-21
177950 Alpha release: Label breakdown categories and other non-obvious concepts Backlog 2017-10-12 2017-11-09
178084 Alpha release: Wikistats 2 UI feedback From Erik Z Backlog 2017-10-13 2017-11-02
178174 Remove AppInstallIId from EventLogging purging white-list Backlog 2017-10-14 2017-11-09
178317 Fonts from fonts.googleapis.com on wikistats Backlog 2017-10-17 2017-11-11
178440 Refine should parse user agent field as it is done on refinery pipeline Backlog 2017-10-18 2017-11-20
178478 Check data from new API endpoints agains existing sources Backlog 2017-10-19 2017-10-18
178504 Update mediawiki_history_reduced oozie job loading AQS druid backend Backlog 2017-10-19 2017-11-20
178587 Fix wikimedia-history revision-deleted data Backlog 2017-10-20 2017-10-19
178813 Beta Release: Support Annotations on Wikistats 2.0 graphs Backlog 2017-10-24 2017-10-26
178832 Investigate AQS cassandra schema hash warninga Backlog 2017-10-24 2017-10-23
178876 Test and possibly raise the Xmx/Xms settings for the Hadoop Yarn Namenode and HDFS datanode daemons Backlog 2017-10-25 2017-11-09
178983 Malformed HTTP message in EventBus logs Backlog 2017-10-26 2017-10-30
179074 Fix mediawiki history page reconstruction bug (similar timestamps) Backlog 2017-10-27 2017-11-20
179093 Support multi DC statsv Backlog 2017-10-27 2017-11-15
179113 Endpoints that 404 no longer have the "Access-Control-Allow-Origin" header Backlog 2017-10-31 2017-11-01
179424 Deal with zero divisions in "small metrics" Backlog 2017-11-01 2017-11-02
179407 Update Mediawiki Table manuals on wiki Backlog 2017-11-01 2017-11-02
179441 Wikistats Bug – In tabular data view, format displayed values Backlog 2017-11-01 2017-11-16
179530 Wikistats Bug: Menu to select projects doesn't work (sometimes?) Backlog 2017-11-02 2017-11-02
179625 Resolve EventCapsule / MySQL / Hive schema discrepancies Backlog 2017-11-03 2017-11-20
179690 Fix mediawiki-history page reconstruction bug (restores) Backlog 2017-11-04 2017-11-20
179692 Fix mediawiki-history page reconstruction bug (restores final) Backlog 2017-11-04 2017-11-03
179689 Rename historical fields in mediawiki-history Backlog 2017-11-04 2017-11-20
179836 Remove EL capsule from meta and add it to codebase Backlog 2017-11-07 2017-11-06
179540 Timestamp format in Hive-refined EventLogging tables is incompatible with MySQL version Backlog 2017-11-07 2017-11-20
179976 Create scala-spark job to ingest simple data sets from Hive-EventLogging to Druid to Pivot Backlog 2017-11-08 2017-11-07
179971 Format timestamps as human-readable datetimes in Wikistats 2.0 table view Backlog 2017-11-08 2017-11-09
179952 Geowiki stopped updating on October 24th - DATA LOSS (read comments) Backlog 2017-11-08 2017-11-17
179943 Restart Analytics JVM daemons for open-jdk security updates Backlog 2017-11-08 2017-11-15
179906 Move non-SI prefixes to user- or locale-specific interface Backlog 2017-11-10 2017-11-09
180266 Wikistats2: The granularity selector does not work for tops metrics Backlog 2017-11-11 2017-11-13
180301 Add CI to all analytics/* repositories and archive obsolete ones Backlog 2017-11-13 2017-11-20
180412 Replace any debouncing with Vue.nextTick Backlog 2017-11-14 2017-11-15
180452 Add documentation for .m suffix code to pagecounts-ez doc page Backlog 2017-11-15 2017-11-16
180556 Alpha Release: Breakdowns don't work in Firefox Backlog 2017-11-16 2017-11-15
180770 Move Wikimetrics to new cloud databases Backlog 2017-11-18 2017-11-17
181064 Purge refined JSON data after 90 days Backlog 2017-11-22 2017-11-21
139019 statistics about edit conflicts according to page type In Progress 2016-07-01 2017-10-31
143743 Set up the foundation for the ReviewStream feed In Progress 2016-08-24 2017-06-07
145164 Add fields needed by ERI to mediawiki.revision-create In Progress 2016-09-10 2017-05-24
147196 EventLogging sees MobileWikiAppFindInPage parsing errors In Progress 2016-11-10 2016-11-09
149736 Bikeshed what events should be exposed in public EventStreams API In Progress 2017-01-02 2017-06-22
144637 Check eventbus Kafka cluster settings for reliability In Progress 2017-01-02 2017-07-27
125394 Ensure that EventBus extension gracefully handles service failures In Progress 2017-01-02 2016-10-12
117221 [Epic] Update official Wikimedia press kit with accurate numbers In Progress 2017-01-02 2017-07-24
121136 Establish a process to periodically review and approve access for hadoop/hue users In Progress 2017-01-02 2016-08-22
148843 GPU upgrade for stats machine In Progress 2017-01-02 2017-08-06
146130 Inconsistent Cassandra disk load shown in metrics and nodetool status In Progress 2017-01-02 2017-04-25
125345 Many error 500 from pageviews API "Error in Cassandra table storage backend" In Progress 2017-01-02 2016-12-08
105815 Pipeline for data-intensive applications from research to productization to integration In Progress 2017-01-02 2016-01-12
144639 Propose metrics along with qualifiers for the press kit In Progress 2017-01-02 2017-07-24
141117 Report on Wikimedia's industry ranking In Progress 2017-01-02 2017-07-24
122245 REST API entry point web request statistics at the Varnish level In Progress 2017-01-02 2017-07-27
102476 RFC: Requirements for change propagation In Progress 2017-01-02 2017-09-13
150439 Tests for swagger spec stream routes in EventStreams In Progress 2017-01-02 2017-08-28
142139 Top API user agents stats In Progress 2017-01-02 2017-10-26
153923 vet edit data on the data lake In Progress 2017-01-02 2017-10-23
155478 Copy cached API requests from raw webrequests table to ApiAction In Progress 2017-01-24 2017-10-26
157088 [EPIC] Develop a JobQueue backend based on EventBus In Progress 2017-02-04 2017-10-25
157092 Support per-topic configuration in EventBus service In Progress 2017-02-04 2017-10-02
155804 log-events topic emitted in EventBus In Progress 2017-02-17 2017-02-16
158896 Provide a spark job processing history and text to extract citations diffs In Progress 2017-02-24 2017-03-02
161027 Puppetize event schema topic configuration In Progress 2017-03-28 2017-10-26
135812 20160431 produces "end timestamp is invalid, must be a valid date in YYYYMMDD format" In Progress 2017-04-02 2016-05-23
111611 Accented letters seem to be rejected in cohort names In Progress 2017-04-02 2016-08-22
116658 Add Application errors for Mediawiki API to x-analytics In Progress 2017-04-02 2017-01-17
157697 Add error component to Dashiki In Progress 2017-04-02 2017-11-07
146774 Add external link to tabs layout In Progress 2017-04-02 2017-02-09
116188 Add help page in wikitech on what the analytics team can do for you similar to release engineering page In Progress 2017-04-02 2017-02-09
141010 Adding top counts for wiki projects (ex: WikiProject:Medicine) to pageview API In Progress 2017-04-02 2017-11-02
124319 Add json linting test for schemas in mediawiki/event-schemas In Progress 2017-04-02 2016-05-02
88775 Add mediacounts to pageview API In Progress 2017-04-02 2017-07-03
87604 Add ops-reportcard dashboard with analysis that shows the http to https slowdown on russian wikipedia In Progress 2017-04-02 2017-03-01
92875 Add page_id and namespace to X-Analytics header in App / api requests In Progress 2017-04-02 2017-05-25
126279 Add pivot parameter to tabular layout graphs {lama} In Progress 2017-04-02 2017-07-31
159840 Alarm on data quality issues In Progress 2017-04-02 2017-10-19
110459 Allow clicking on links in annotations In Progress 2017-04-02 2017-02-09
89726 Analyze difference in Edit Schema "bounce rates" across wikis {lion} In Progress 2017-04-02 2016-09-26
124082 As an end-user I shouldn't see non-articles in the list of top articles In Progress 2017-04-02 2017-11-12
118842 Backfill pageview_hourly sanitization - 1 month - {hawk} - DUPLICATE THIS TASK FOR EACH MONTH TO BACKFILL In Progress 2017-04-02 2017-05-16
136126 Better menu for metrics In Progress 2017-04-02 2017-02-09
142408 Better publishing of Annotations about Data Issues In Progress 2017-04-02 2017-05-16
121912 Better redirect handling for pageview API In Progress 2017-04-02 2017-08-04
157978 Blog post about druid In Progress 2017-04-02 2017-06-05
143689 Bookmarkable date filters for browser stats dashboard In Progress 2017-04-02 2017-03-20
137454 Bot from an Azure cloud cluster is causing a false pageview spike (can we identify as bot?) In Progress 2017-04-02 2017-10-26
148461 Bot Identification: Inconsistent data in #all-sites-by-os-and-browser for IE7 In Progress 2017-04-02 2017-07-31
120330 Bot to call global metrics to event page {kudu} In Progress 2017-04-02 2016-01-12
136127 Breakdowns should be bookmarkeable In Progress 2017-04-02 2017-02-09
58575 Browser and platform stats for logged-in vs. anon users for security and product support decisions In Progress 2017-04-02 2017-11-02
131127 Browser Reports. Break down "Other" bucket a little more? In Progress 2017-04-02 2017-05-16
6537 Categories created using Tamil words not recognised in stats In Progress 2017-04-02 2017-01-23
121286 Central repository of global metrics reports {kudu} In Progress 2017-04-02 2016-08-22
113695 Clean the code review queue of analytics/wikistats In Progress 2017-04-02 2016-02-29
132691 Clean up property passing in dashiki In Progress 2017-04-02 2017-02-09
159269 Clean up remaining Dashiki configs on meta In Progress 2017-04-02 2017-10-23
132405 Collect information about how we collect user statistics in one place In Progress 2017-04-02 2017-08-07
113817 Connect Hadoop records of the same request coming via different channels In Progress 2017-04-02 2016-10-04
123958 Consider scrapping Schema:PageContentSaveComplete and Schema:NewEditorEdit, given we have Schema:Edit In Progress 2017-04-02 2017-10-31
90240 Could it be that the geo IP matching is not accurate for Africa? In Progress 2017-04-02 2016-08-15
116678 Country mapping routine for proxied requests In Progress 2017-04-02 2017-07-20
117290 Create a tool that can read the elements of a wiki template and call the API {kudu} In Progress 2017-04-02 2016-02-18
147009 Create a Universal Layout for Dashiki for staging / testing config purposes In Progress 2017-04-02 2017-08-14
119897 Create cron on 1002 to remove CirrusSearchRequest partitions In Progress 2017-04-02 2016-01-12
90759 Create Daily & Monthly pageview dump with country data and Visualize on UI In Progress 2017-04-02 2017-10-19
159233 Create dashboard for upload wizard In Progress 2017-04-02 2017-09-14
112284 Create new table for 'referer' aggregated data In Progress 2017-04-02 2017-10-09
138396 Create ops dashboard with info like ipv6 traffic split In Progress 2017-04-02 2017-06-12
161731 Create reliable change stream for specific wiki In Progress 2017-04-02 2017-10-23
95456 "Create Report" button does not appear when uploading a new cohort In Progress 2017-04-02 2016-09-19
127995 Create table in hive with a continent lookup for countries In Progress 2017-04-02 2017-07-31
160748 Create /v2/schema/:schema_uri endpoint for eventstreams that proxies schemas from eventbus In Progress 2017-04-02 2017-08-30
92502 Dashboard Directory Design Feedback In Progress 2017-04-02 2017-05-16
144299 Dashboards working on mobile In Progress 2017-04-02 2017-04-24
156657 dashiki should execute tests on jenkins In Progress 2017-04-02 2017-02-09
136125 Dashiki, Unique Devices and Pageview data breakdown doesn't work if any of the items are not available for the project In Progress 2017-04-02 2017-02-09
156844 Decommission old dbstore hosts (db1046, db1047) In Progress 2017-04-02 2017-11-17
152546 de-duplicate archive records matching revision records in mediawiki_history In Progress 2017-04-02 2017-10-05
149594 Delete stale topics from main Kafka clusters In Progress 2017-04-02 2017-07-11
120713 delete useless wikimetrics.report or cohort records In Progress 2017-04-02 2017-02-09
118841 Deploy pageview sanitization and start ongoing process {hawk} In Progress 2017-04-02 2017-05-16
131158 Describe threat model for sanitized pageview data {mole} In Progress 2017-04-02 2017-10-19
158166 Discuss labsdb visibility of rev_text_id and ar_comment In Progress 2017-04-02 2017-03-13
112846 Display automata and humans separately on zero results rate graph In Progress 2017-04-02 2016-01-12
121262 Display global metrics report results on same page as report inputs {kudu} In Progress 2017-04-02 2016-08-22
148656 Edit analysis dashboard Failures by User Type chart does not update correctly In Progress 2017-04-02 2017-07-17
160644 Eventstreams graphite disk usage In Progress 2017-04-02 2017-08-29
118310 Expose the results of the global metric at a public link, that's available immediately for the API {kudu} In Progress 2017-04-02 2016-03-14
142535 Find out what happens to the old rows in the revision table In Progress 2017-04-02 2017-03-20
117018 Fix the pageview API "top" spec and 404 reporting {slug} In Progress 2017-04-02 2017-04-17
133407 fundraising-tech request: browser version breakdown by country In Progress 2017-04-02 2017-09-19
139487 Get 'sparklyr' working on stats1005 In Progress 2017-04-02 2017-11-11
89453 Hand off of Christian's MaxMind geolocation databases repository In Progress 2017-04-02 2017-07-03
119996 Have dashiki read and write GET params to pass stateful versions of dashboard pages {crow} In Progress 2017-04-02 2017-08-14
98831 Honor DNT header for access logs & varnish logs In Progress 2017-04-02 2017-05-16
115119 Implement Schema:ExternalLinksChange In Progress 2017-04-02 2017-07-17
152731 Implement server side filtering (if we should) In Progress 2017-04-02 2017-11-02
155014 Import 2001 wikipedia data In Progress 2017-04-02 2017-10-09
127850 Improve Hue user management In Progress 2017-04-02 2017-10-26
142395 Improve initial load performance for dashiki dashboards In Progress 2017-04-02 2017-02-09
126290 Improve joining mechanism between webrequest data and edit data for i.e. sampling pageviews In Progress 2017-04-02 2017-10-09
142073 Improve user management for AQS In Progress 2017-04-02 2017-10-26
156523 Investigate adding user-friendly testing functionality to Reportupdater In Progress 2017-04-02 2017-08-14
89397 Investigate getting redirect_page_id as an x_analytics field using the X analytics extension. {pika} In Progress 2017-04-02 2017-07-03
144837 Investigate lowering "per-article" resolution data in AQS In Progress 2017-04-02 2017-08-14
114469 Investigate US traffic by state normalized by population In Progress 2017-04-02 2017-10-26
154912 Is User-Agent data PII when associated with Action API requests? In Progress 2017-04-02 2017-11-12
115634 --- Items above are triaged ----------------------- In Progress 2017-04-02 2017-10-02
148469 Just an idea: poly-graph In Progress 2017-04-02 2017-08-10
108414 Load API request count and latency data from Hadoop to a dashboard In Progress 2017-04-02 2017-11-12
126501 Load Avro schemas from configurable external path In Progress 2017-04-02 2017-07-27
156037 Load cirrussearch data into druid In Progress 2017-04-02 2017-10-19
126494 Look into encrypting logs sent between mediawiki app servers and kafka In Progress 2017-04-02 2017-10-09
152222 Make aggregated MediaWiki Pingback data publicly available In Progress 2017-04-02 2017-08-31
118402 Make AQS return 0 instead of no values {slug} In Progress 2017-04-02 2017-04-17
114162 Make sunburst and stacked-bars resize with window {crow} In Progress 2017-04-02 2016-03-14
110903 Make webperf eventlogging consumers use eventlogging on Kafka In Progress 2017-04-02 2017-11-20
131280 Making geowiki data public In Progress 2017-04-02 2017-07-17
102079 Metrics about the use of the Wikimedia web APIs In Progress 2017-04-02 2017-11-12
135174 Move contents of ee-dashboards to edit-analysis.wmflabs.org In Progress 2017-04-02 2017-10-31
138207 [Open question] Improve bot identification at scale In Progress 2017-04-02 2017-09-21
134524 Pageview API: Limit (and document) size of data you can request In Progress 2017-04-02 2017-06-15
144100 Pageview dumps incorrectly formatted, looks like a result of possibly malicious activity In Progress 2017-04-02 2017-05-29
145828 passport-mediawiki-oauth doesn't support callback parameter In Progress 2017-04-02 2017-03-16
127571 Percentage of users with DNT on In Progress 2017-04-02 2016-09-19
161185 Pivot "MediaWiki history" data lake: Feature request for "Event Users" In Progress 2017-04-02 2017-10-23
161186 Pivot "MediaWiki history" data lake: Feature request for "Time" dimension to sp\lit by calendar month / quarter / year -- needs druid 0.10 In Progress 2017-04-02 2017-06-29
160630 Please update Tulu Language(tcy)in Wikipedia Statistics. In Progress 2017-04-02 2017-06-26
152522 Prevent notebooks on spark to launch 2 pyspark instances instead of 1 In Progress 2017-04-02 2017-06-05
118839 Productionize Pageview_sanitization hive code with Oozie job and refinery inclusion {hawk} In Progress 2017-04-02 2017-05-16
159264 Prototype counting of requests with real time (streaming data) In Progress 2017-04-02 2017-07-03
161149 Provide edit tags in the Data Lake edit data In Progress 2017-04-02 2017-10-19
150713 Provide filterable line graph for browser-family/browser-major In Progress 2017-04-02 2017-07-31
161146 Provide historical redirect flag in Data Lake edit data In Progress 2017-04-02 2017-11-13
117480 Provide machine readable directory indexes on http://datasets.wikimedia.org/aggregate-datasets/ In Progress 2017-04-02 2016-01-12
133575 Provide weekly top pageviews stats In Progress 2017-04-02 2017-07-31
136732 Puppetize job that saves old versions of geoIP database In Progress 2017-04-02 2017-05-16
128623 Purge all Schema:Echo data after 90 days In Progress 2017-04-02 2016-03-07
131782 Put data needed for edits metrics through Event Bus into HDFS In Progress 2017-04-02 2017-07-05
146911 Quantify false positives when filtering for number of distinct user agents per page in top pages computation In Progress 2017-04-02 2017-06-15
112009 Re-baselining checkpoints periodically In Progress 2017-04-02 2016-01-12
116387 Refactor webrequest_source partitions and oozie jobs In Progress 2017-04-02 2017-07-31
126281 [Regression] stats.wikipedia.org redirect no longer works ("Domain not served here") In Progress 2017-04-02 2016-08-08
61832 Remove ad-hoc UA logging from existing schemas In Progress 2017-04-02 2017-03-13
156965 Remove user_agent_map from pageview_hourly long term In Progress 2017-04-02 2017-05-16
126218 Replicate wikitech wikis to analytics-store.eqiad.wmnet In Progress 2017-04-02 2016-02-11
103726 Report page views for labs instances In Progress 2017-04-02 2016-09-19
152257 Report updater should support Graphite mapping plugins In Progress 2017-04-02 2017-10-26
144714 [REQUEST] Extract search queries from HTTP_REFERER field for a Wikibook In Progress 2017-04-02 2016-10-06
125015 Requests to (hard) redirect pages return their target's contents but are counted as pageviews to the redirect page In Progress 2017-04-02 2016-01-28
145935 Responses on pageview API should be lighter In Progress 2017-04-02 2017-05-16
157435 Review ACLs for the Analytics VLAN In Progress 2017-04-02 2017-10-09
156656 Review parent task for any potential pageview definition improvements In Progress 2017-04-02 2017-10-05
137321 Run ETL for wmf_raw.ActionApi into wmf.action_* aggregate tables In Progress 2017-04-02 2017-08-30
159584 Secure hue and other private data access sites with 2FA In Progress 2017-04-02 2017-05-16
76782 security review of Wikimetrics {dove} In Progress 2017-04-02 2017-02-23
157981 Serve global unique device counts externally In Progress 2017-04-02 2017-11-02
150483 Set up a fake Pageview API endpoint for the beta cluster In Progress 2017-04-02 2017-05-16
108850 Set up auto-purging after 90 days {tick} In Progress 2017-04-02 2017-02-01
136025 Simplify readiness checking by making a ready computed In Progress 2017-04-02 2017-02-09
114884 Some special characters break Wikimetrics' encoding {dove} In Progress 2017-04-02 2016-09-19
160311 Sort inconsistency in AQS timestamp behavior In Progress 2017-04-02 2017-07-13
128374 Sort out analytics service dependency issues for cp* cache hosts In Progress 2017-04-02 2017-10-02
159962 Spike: Spark 2.x as cluster default (working with oozie) In Progress 2017-04-02 2017-06-15
138505 Split opera mini in proxy or turbo mode In Progress 2017-04-02 2017-10-23
161635 Storage for banner history data In Progress 2017-04-02 2017-10-24
71145 Story: AnalyticsEng has editor_day table in labsdb In Progress 2017-04-02 2016-09-19
141506 Suddenly outrageous higher pageviews for main pages In Progress 2017-04-02 2017-09-13
148053 Switch to fetch away from jquery In Progress 2017-04-02 2017-04-25
160679 Test pushing EventLogging through the ELK stack In Progress 2017-04-02 2017-03-20
147967 The WMF-Last-Access Set-Cookie header should follow RFC 2965 syntax rather than the pre-RFC Netscape format In Progress 2017-04-02 2016-10-17
106034 Too few page views for June/July 2015 In Progress 2017-04-02 2016-01-28
117236 Track overall traffic, without any filtering, broken down into major categories, for internal use. In Progress 2017-04-02 2017-10-09
159046 Track page views by page ID rather than title (handles moved pages) In Progress 2017-04-02 2017-07-17
93217 Troubleshoot Wikimetrics RAE reports In Progress 2017-04-02 2016-09-19
153702 Update active editor metrics to use consensus definition In Progress 2017-04-02 2017-09-12
158106 Update EventBus RCFeed config to use newly refactored settings In Progress 2017-04-02 2017-06-22
113234 Update passport-mediawiki module URLs and documentation In Progress 2017-04-02 2017-03-16
157977 upgrade druid and pivot In Progress 2017-04-02 2017-07-13
114199 Upgrade eventlogging servers to Jessie In Progress 2017-04-02 2017-10-09
161150 Use native timestamp types in Data Lake edit data (needs Hive 1.2) In Progress 2017-04-02 2017-11-09
151904 User limits for stat machines. Limit space on /home dir and possibly /tmp In Progress 2017-04-02 2017-10-23
76914 User reads result of validation after creating a cohort In Progress 2017-04-02 2016-08-22
76432 Validate JsonSchemaContent using MediaWIki core's handling In Progress 2017-04-02 2016-01-12
120036 Vital Signs: Please make the data for enwiki and other big wikis less sad, and not just be missing for most days In Progress 2017-04-02 2017-10-26
120037 Vital Signs: Please provide an "all languages" de-duplicated stream for the Community/Content groups of metrics In Progress 2017-04-02 2017-10-26
71462 Wikimetrics is not supporting mlwiki cohort In Progress 2017-04-02 2017-02-23
134231 Wikipedia Clickstream dataset. Programmatic Access In Progress 2017-04-02 2017-11-02
145197 WMF pageview API (404 error) when requesting statitsics over around 1000 files on GLAMorgan In Progress 2017-04-02 2016-09-16
162308 Eventlogging client needs to support offline events In Progress 2017-04-06 2017-08-16
162365 ExternalLinksChange Logging instrumentation is completely broken In Progress 2017-04-07 2017-09-21
119772 Create dashboard showing MediaWiki tarball download statistics In Progress 2017-04-10 2017-04-10
162618 Measure portal pageviews In Progress 2017-04-11 2017-10-05
162933 Endpoint for average view rate in Pageview API In Progress 2017-04-14 2017-08-04
44360 Provide regular cross-wiki reports on flagged revisions status In Progress 2017-04-16 2017-04-30
163113 Adding breakdowns to mw edit history reconstruction: wiki projects, categories (cohort) In Progress 2017-04-18 2017-10-19
163134 Reportupdater writes a README in the output folder In Progress 2017-04-18 2017-10-09
163252 Add templating support to reportupdater scripts In Progress 2017-04-19 2017-10-19
115042 Make banner impression counts available somewhere public In Progress 2017-04-20 2017-07-17
163725 Enable nested on-wiki config pages in mediawiki-storage In Progress 2017-04-25 2017-05-04
163797 add a more friendly message to ladp authentication box for pivot In Progress 2017-04-26 2017-10-09
163789 Investigate whether we could calculate "hourly unique devices" In Progress 2017-04-26 2017-05-08
163933 Investigate oozie suspended workflows In Progress 2017-04-27 2017-05-04
164008 Update druid to latest release In Progress 2017-04-28 2017-05-25
164201 AQS unique devices api should report offset/underestimate separately In Progress 2017-05-02 2017-05-04
164259 Add VSL error counters to Varnishkafka stats In Progress 2017-05-03 2017-08-04
164280 Host API for token persistence dataset In Progress 2017-05-03 2017-05-04
164377 [Spike] Store article quality data inside hadoop and make AQS outputs a public API In Progress 2017-05-04 2017-09-06
164500 Add jobs for druid compaction for pageviews data set In Progress 2017-05-05 2017-05-04
164596 Provide uniques offset/underestimate breakdowns in AQS In Progress 2017-05-06 2017-10-19
165634 Add li: Wikibooks to stats.wikimedia.org In Progress 2017-05-18 2017-10-21
165560 Artificial spike in offset of unique devices from November to February 6th on wikidata In Progress 2017-05-18 2017-06-26
166249 Bulk/Batch event endpoint In Progress 2017-05-25 2017-11-02
166248 Upgrade Analytics Cluster to Java 8 In Progress 2017-05-25 2017-10-23
166339 Are watchlists dead? In Progress 2017-05-26 2017-05-29
166331 Pivot - Article Page Views In Progress 2017-05-26 2017-05-29
166341 SSDs for main Kafka clusters In Progress 2017-05-26 2017-05-29
150106 Type collisions in log events causing indexing failures in ELK Elasticsearch In Progress 2017-05-26 2017-11-06
166414 Explore NavigationTiming by faceted properties - EventLogging refine In Progress 2017-05-27 2017-11-20
166689 Provide top domain and data to truly test superset In Progress 2017-06-01 2017-10-02
166832 Import Kafka messages into HDFS authenticating with TLS/SSL In Progress 2017-06-02 2017-10-23
166833 Produce webrequests from varnishkafka to Kafka with Kafka message timestamp set to configurable content field In Progress 2017-06-02 2017-08-04
166937 Broken /a/refinery-source/guard/run_all_guards.sh script on stat1002 In Progress 2017-06-04 2017-10-19
166877 Bring the Editor Engagement Dashboard back In Progress 2017-06-06 2017-10-31
167039 Upgrade Kafka on main cluster with security features In Progress 2017-06-06 2017-11-02
167180 Emit revision-score event to EventBus and expose in EventStreams In Progress 2017-06-07 2017-09-06
167290 Sqoop wbc_entity_usage from all wikis into hadoop (HDFS) In Progress 2017-06-08 2017-10-26
167427 Configure superset to query mysql slaves In Progress 2017-06-09 2017-11-02
167494 Some fields in Pivot should be numbers In Progress 2017-06-10 2017-11-20
167608 Add caused_by_user_text to mediawiki_page_history In Progress 2017-06-12 2017-11-06
167673 Address design feedback from Volker In Progress 2017-06-13 2017-10-02
143819 Data request for logs from SparQL interface at query.wikidata.org In Progress 2017-06-13 2017-07-25
167907 Incorporate data from the GeoIP2 ISP database to webrequest In Progress 2017-06-15 2017-08-28
107250 Remove links in wikistats to minnan.wikipedia.org In Progress 2017-06-16 2017-06-15
168414 Purge all old data from EventLogging master In Progress 2017-06-21 2017-10-02
168573 Dashiki Cleanup In Progress 2017-06-22 2017-06-21
168554 Default hive table creation to parquet - needs hive 2.3.0 In Progress 2017-06-22 2017-06-29
168648 Productionize analysis of editcount vs per_user_revision_count In Progress 2017-06-23 2017-10-26
169672 Bucketize userEditCount in EL instrumentation In Progress 2017-07-05 2017-07-06
169900 ---------------- Discussed above -------------------- In Progress 2017-07-07 2017-10-23
170019 Script that synchronizes EL purging white-list with schema talk pages In Progress 2017-07-08 2017-10-02
170157 decommission rcs100[12] In Progress 2017-07-11 2017-08-03
170162 hdfs password file for mysql should be re-generated when the password file is changed by puppet In Progress 2017-07-11 2017-10-05
89887 Clean up permissions for privatedata files on stat1002 - they should be group readable by statistics-privatedata-users In Progress 2017-07-12 2017-07-13
170429 Deploy Wikistats and analytics.wikimedia.org via SCAP In Progress 2017-07-13 2017-10-23
170606 Add Accept header to webrequest logs In Progress 2017-07-14 2017-10-19
170620 Alarm on errors on /var/log/upstart/eventlogging* files In Progress 2017-07-14 2017-10-02
170826 Enable base::firewall on stat boxes after restricting Spark REPL ports. In Progress 2017-07-18 2017-10-19
171048 Eventbus does not handle gracefully changes in DNS recursors In Progress 2017-07-20 2017-10-09
171117 Track zim file downloads In Progress 2017-07-20 2017-11-11
170650 [Investigate] Hadoop integration for ORES training In Progress 2017-07-21 2017-07-24
171203 Run eventlogging purging script on beta labs to avoid disk getting full In Progress 2017-07-21 2017-10-19
172009 Add referer to WebrequestData In Progress 2017-07-29 2017-10-09
172304 WiViVi Broken in Firefox 50 (Linux only) In Progress 2017-08-03 2017-08-03
172335 WiViVi: Per-person should account for connected percentage? In Progress 2017-08-03 2017-08-03
172410 Phase out and replace analytics-store (multisource) In Progress 2017-08-04 2017-08-10
172532 Refactor analytics cronjobs to alarm on failure In Progress 2017-08-05 2017-10-05
172579 Weird performance of sqoop job on Edit Reconstruction In Progress 2017-08-05 2017-10-02
136084 Unexpected increase in traffic for 4 languages in same region, on smaller projects In Progress 2017-08-08 2017-08-07
172832 Investigate use-cases for delayed job executions In Progress 2017-08-09 2017-08-22
173006 EventStreams (via KafkaSSE) does not consume from newly added partitions in topic In Progress 2017-08-11 2017-10-19
173097 Decommission stat1002.eqiad.wmnet In Progress 2017-08-12 2017-09-28
173244 [Investigate] Use PMML for prediction model serialization In Progress 2017-08-14 2017-08-16
173513 Create a database on the wikireplica servers called "datasets_p" In Progress 2017-08-18 2017-10-27
173514 Document the process for importing a new "datasets_p" table In Progress 2017-08-18 2017-09-05
173511 Implement technical details and process for "datasets_p" on wikireplica hosts In Progress 2017-08-18 2017-11-15
173492 Tune Varnishkafka delivery errors to be more sensitive In Progress 2017-08-18 2017-10-02
173604 Reportupdater: do not write execution control files in source directories In Progress 2017-08-19 2017-10-23
173720 Add pagecounts by article and top pagecounts to AQS In Progress 2017-08-22 2017-08-21
173850 Possible WMF deployed extension PHP 7 issues In Progress 2017-08-23 2017-10-12
174386 Remove sensitive fields from whitelist for QuickSurvey schemas (end of Q2) In Progress 2017-08-29 2017-10-02
174474 ApiAction log in data lake doesn't record Wikibase API actions In Progress 2017-08-30 2017-08-31
174600 Add the ability to sign and verify jobs In Progress 2017-08-31 2017-10-23
166081 rack/setup/install conf1004-conf1006 In Progress 2017-08-31 2017-09-28
174675 Create phabricator space for tickets with legal restrictions In Progress 2017-09-01 2017-11-15
174796 Productionize navigation vectors In Progress 2017-09-02 2017-10-25
174890 Install R on stat1004? In Progress 2017-09-04 2017-11-21
174946 R execution on stat1005 -> 'stack smashing error' In Progress 2017-09-05 2017-10-05
174981 Add pageviews total counts to WDQS In Progress 2017-09-06 2017-09-28
175210 Select candidate jobs for transferring to the new infrastucture In Progress 2017-09-07 2017-11-02
175212 Services Q2 2017/18 goal: Migrate a subset of jobs to multi-DC enabled event processing infrastructure. In Progress 2017-09-07 2017-11-14
175395 Implement Schema:Print purging strategy In Progress 2017-09-09 2017-11-21
175344 Move away from jmxtrans in favor of prometheus jmx_exporter In Progress 2017-09-09 2017-10-25
175438 Hits from private AbuseFilters aren't in the stream In Progress 2017-09-10 2017-10-02
175727 Support topic arrays in ChangeProp config In Progress 2017-09-13 2017-09-21
175800 Allow easy tuning of the jobqueue concurrency. In Progress 2017-09-14 2017-09-21
175870 Correct pageview_hourly and derived data for T141506 In Progress 2017-09-14 2017-09-21
175790 dbstore1002 (analytics store) enwiki lag due to blocking query In Progress 2017-09-14 2017-10-20
175780 Requests for new JobQueue monitoring capabilities In Progress 2017-09-14 2017-09-21
175957 Options for implementing JobQueue statistics methods In Progress 2017-09-15 2017-09-21
175952 Split ChangeProp metrics by wiki In Progress 2017-09-15 2017-09-21
64570 WikiReportsLocalizations.pm still fetches language names from SVN In Progress 2017-09-16 2017-09-21
176093 Give +w permission for users in /srv folder in SWAP Machines In Progress 2017-09-23 2017-09-21
176426 Implement purging scheme for eventlogging data on top of eventlogging refine In Progress 2017-09-23 2017-10-02
176143 Improve Wikistats UI for mobile In Progress 2017-09-23 2017-09-21
176091 Mount dumps on SWAP machines (notebook1001.eqiad.wmnet / notebook1002.eqiad.wmnet) In Progress 2017-09-23 2017-10-02
176478 Renovation of Wikistats production jobs In Progress 2017-09-23 2017-09-28
176126 Update node-rdkafka version to v2.x In Progress 2017-09-23 2017-11-15
176996 Private geo wiki data in new analytics stack In Progress 2017-09-29 2017-10-02
176984 Productionitize netflow job In Progress 2017-09-29 2017-10-05
177097 Combine Hive Year / Month / Day / Hour partitions into ISO date string In Progress 2017-09-30 2017-10-02
177458 Add the prometheus jmx exporter to all the Hadoop daemons In Progress 2017-10-06 2017-11-06
177460 Add the prometheus jmx exporter to all the Zookeeper daemons In Progress 2017-10-06 2017-10-06
177643 Alpha Release: Link on message box on stats.wikimedia.org to new wikistats 2.0 domain In Progress 2017-10-07 2017-10-09
177647 Varnishkafka does not play well with varnish 5.2 In Progress 2017-10-07 2017-10-09
178017 Add edit/upload distinction to mediawiki history pipeline In Progress 2017-10-12 2017-10-12
177951 Add flagged revision status statistics to Wikistats 2.0 In Progress 2017-10-12 2017-10-12
177965 Beta Release: Resiliency, Rollback and Deployment of Data In Progress 2017-10-12 2017-10-12
178015 Beta Release: Wikistats: support annotations In Progress 2017-10-12 2017-10-12
178018 Consider adding breadcrumbs to Wikistats 2 In Progress 2017-10-12 2017-10-12
178016 Make Wikistats data easily embedable on-wiki In Progress 2017-10-12 2017-10-12
177927 Refactor kafka_config.rb and and kafka_cluster_name.rb in puppet to avoid explicit hiera calls In Progress 2017-10-12 2017-10-13
178183 geowiki data for Global Innovation Index - 2017 In Progress 2017-10-14 2017-11-03
178198 Partially purge user-agent map for EventLogging mobile schemas In Progress 2017-10-14 2017-10-19
178399 Survey dashboard layout for dashiki In Progress 2017-10-18 2017-10-19
178448 Remove "bot" from metrics/pageviews/per-article In Progress 2017-10-19 2017-10-26
178812 Beta release: Wikistats: Corners of dashboard miniatures overflow when no data In Progress 2017-10-24 2017-10-23
179192 Check analytics1037 power supply status In Progress 2017-10-28 2017-10-30
179444 Wikistats Bug – Put view settings in URL so it can be shared In Progress 2017-11-01 2017-11-02
115160 can't remove users from cohort in Iceweasel (aka Firefox, works fine in Chromium) In Progress 2017-11-02 2017-11-02
179748 Reading Common Crawl data from hadoop / webproxy performance In Progress 2017-11-04 2017-11-06
179752 Clear site data on MediaWiki log out In Progress 2017-11-05 2017-11-06
179975 Beta: How to link to/cite Wikistats 2.0 In Progress 2017-11-08 2017-11-09
180017 Timeouts on event delivery to EventBus In Progress 2017-11-09 2017-11-15
180270 RStudio web version on SWAP In Progress 2017-11-11 2017-11-16
180442 Export burrow metrics to prometheus In Progress 2017-11-15 2017-11-17
180921 Referrer policy for browsers which only support the old spec In Progress 2017-11-20 2017-11-20
180971 Create LVS endpoing for druid-public-overlord (for oozie job indexing) In Progress 2017-11-21 2017-11-20
181094 A statbox to update the WDCM system In Progress 2017-11-22 2017-11-21
76790 change puppetization for scheduler/queue {ops} {dove} In Progress 2017-11-22 2017-11-21
76780 Change wikimetrics admin script - no symlinking [8 pts] {dove} In Progress 2017-11-22 2017-11-21
76770 change wikimetrics in labs to use debian packages [13 pts] {dove} In Progress 2017-11-22 2017-11-21
75831 Consider idea of 1 sprint for EL operational love sprint In Progress 2017-11-22 2017-11-21
75828 Create monitoring checks to make sure events end up in DB In Progress 2017-11-22 2017-11-21
76792 create new group for devs to sudo run wikimetrics admin script {ops} {dove} In Progress 2017-11-22 2017-11-21
75827 Create single place to look at graphs indicating outages In Progress 2017-11-22 2017-11-21
75830 Dashboard of status of our systems (one stop shopping) In Progress 2017-11-22 2017-11-21
76789 Debianize wikimetrics dependencies not in trusty {ops} {dove} In Progress 2017-11-22 2017-11-21
85032 design a system to assist software developers and researchers to perform automated data unit testing before pushing to production In Progress 2017-11-22 2017-11-21
78009 EPIC: Longterm fix of data warehouse replicating to Labs In Progress 2017-11-22 2017-11-21
76726 EPIC: Productionizing Wikimetrics {dove} In Progress 2017-11-22 2017-11-21
75824 Establish support model for EL? (e.g. more ops involvement) In Progress 2017-11-22 2017-11-21
181036 Pull netflow data in realtime from Kafka via Tranquillity/Spark In Progress 2017-11-22 2017-11-21
78405 SPIKE: experimenting with importing Revision history from XML dumps into an easier to use format, Avro In Progress 2017-11-22 2017-11-21
75913 Talk to research about Mobile EL pipeline use case In Progress 2017-11-22 2017-11-21
76769 upgrade wikimetrics to trusty [8 pts] {dove} In Progress 2017-11-22 2017-11-21
76092 weekly/monthly granularity for pageviews in Dashiki In Progress 2017-11-22 2017-11-21