Analytics Status Report

Project Analytics from 2017-04-01 to 2017-07-01

Help

In Progress 130432 Fix iOS uniques in mobile_apps_uniques_daily after 5.0 launch Screep Done None
In Progress 130542 Landing page for unique devices datasets on dumps (like other datasets we have) Screep Done None
In Progress 89847 Estimate roughly of how many users might not have javascript capable/enable browsers, use CSS to crosscheck. Screep Done None
In Progress 130861 Investigate and implement possible simplification of Cassandra Logstash filtering Screep Done None
In Progress 131085 EventLogging vagrant role fails to provision Screep Done None
In Progress 90034 Hacking: Wiki tools that use revision quality scoring Screep Done None
In Progress 90147 Review and clean up JS on new graphoid service Screep Done None
In Progress 90203 Upgrade daily/monthly aggregations of pageview dumps to new data files Screep Done None
In Progress 90230 Daily aggregation of page view dumps stalled Screep Done None
In Progress 70966 Epic: AnalyticsEng has fully dimentionalized Page View counts Screep Done None
In Progress 131888 geowiki dataset for cornell Screep Done None
In Progress 90606 Avoid cache fragmenting URLs for Share a Fact shares Screep Done 1.0
In Progress 90635 Strategy banner impressions Screep Done 1.0
In Progress 131977 Stop using global eventlogging install on hafnium (and any other eventlogging lib user) Screep Done 13.0
In Progress 132283 Determine which Action API parameters to whitelist/blacklist for action_param_hourly aggregate table Screep Done None
In Progress 132322 kafkatee cronspam from oxygen Screep Done None
In Progress 132346 cronspam from cpXXXX hosts related to varnishkafka non existent processes Screep Done None
In Progress 132374 Generate a list of junk CN cookies being sent by clients Screep Done None
In Progress 90649 Provide performant query access to banner show/hide numbers Screep Done 4.0
In Progress 132456 Pageview API alarms Screep Done None
In Progress 132500 Clicktracking data not matching up with donation totals Screep Done 4.0
In Progress 58426 Image link clicks might not get logged Screep Done None
In Progress 132761 pagecounts-ez files are missing data Screep Done None
In Progress 132795 Unique devices endpoint Graphana Dashboard {bear} Screep Done None
In Progress 132965 Investigate recent decline in views and daily users Screep Done None
In Progress 133067 Verify X-Analytics: preview=1 in stable Screep Done 0.0
In Progress 133312 Dashiki breakdown layout problems. UI Screep Done None
In Progress 90766 Parse mediaviewer team's requirements for EventLogging {oryx} Screep Done None
In Progress 91331 Publish aggregate geodumps of article pageviews Screep Done None
In Progress 133718 Searching for nl... does not bring nlwikipedia only nlwikidata Screep Done None
In Progress 91369 Updated languages are not appearing on Language Dashboard Screep Done None
In Progress 134426 Review shared data namespace (tabular data) implementation Screep Done None
In Progress 134433 Augment 'Add a Wiki' process to include Analytics pageview whitelist Screep Done None
In Progress 134513 AQS Cassandra cluster: Restart cassandra-metrics-collector Screep Done None
In Progress 91532 Configure CORS on datasets.wikimedia.org Screep Done None
In Progress 134861 Data need: Explore range of article revision comparisons Screep Done 2.0
In Progress 134981 deployment-aqs01.deployment-prep.eqiad.wmflabs doesn't respond to ssh / hung process Screep Done None
In Progress 91701 Create dashboard to track key authentication metrics before, during and after AuthManager rollout Screep Done None
In Progress 135704 Add kartik to analytics-privatedata-users Screep Done None
In Progress 91749 Log the X-Cache header in the webrequest logs {hawk} Screep Done None
In Progress 91760 Ran out of captcha images Screep Done None
In Progress 92236 Newly added language ky and pa doesn't reflect in Language Limn Graph Screep Done None
In Progress 92237 language-reportcard.wmflabs.org shows wrong graphs - data swapped Screep Done None
In Progress 92435 Code changes in VCL to add a Last-Access cookie to track "top domain" uniques [13 pts] {bear} Screep Done None
In Progress 47718 Different Collations specified for the 'log' database vs the tables in them Screep Done None
In Progress 136295 hive / beeline query for interlanguage links fails Screep Done None
In Progress 136333 dbstore1002 crashed Screep Done None
In Progress 136405 Jmxtrans failures on Kafka hosts caused metric holes in grafana Screep Done None
In Progress 71615 Make webrequest partition validation handle races between time and sequence numbers Screep Done None
In Progress 136844 Investigate where Kafka records will almost all null fields are coming from Screep Done None
In Progress 92920 Turn off WP Zero's Limn-Dashboards & put up a "moved sign" Screep Done None
In Progress 137174 Verify there are no analytics jobs accessing Zero portal Screep Done None
In Progress 92985 Onboard Madhu Screep Done None
In Progress 137422 Refactor the default cassandra monitoring into a separate class Screep Done None
In Progress 93185 Disk space full on vanadium from logs in /var/log/upstart Screep Done None
In Progress 72085 Raw webrequest partitions that were not marked successful Screep Done None
In Progress 138318 Capacity projections of pageview API document on wikitech Screep Done 5.0
In Progress 93690 Update main menu schema to include collections for limn graphs Screep Done None
In Progress 94481 Mobile PMs has visualization on session-related metrics from Wikipedia Apps Screep Done None
In Progress 94744 Instrument “tags” and anonymous gather pages to track engagement with browse. Screep Done 3.0
In Progress 138646 "Change chart type" is quoted as a message, but there is no such message Screep Done None
In Progress 94926 vanadium failed disk /dev/sda Screep Done None
In Progress 95027 As an end user, i'd like an up to date set of documentation on how to access our event logging data, so that I can make data informed decisions Screep Done None
In Progress 140000 Design new UI for Wikistats 2.0 Screep Done None
In Progress 140121 Multimedia analytics cron job not been running for a few months? Screep Done None
In Progress 140447 confluent-kafka (dependency of eventlogging) fails to build in mediawiki-vagrant Screep Done None
In Progress 140908 Move efSchemaValidate out of global scope Screep Done None
In Progress 95172 Dashboard Directory- Hay collaboration Screep Done None
In Progress 141054 Statsv down, affects metrics from beacon/statsv (e.g. VisualEditor, mw-js-deprecate) Screep Done 0.0
In Progress 95257 {story} Community downloads new pageview dumps Screep Done None
In Progress 141360 stat1004 doesn't show up in ganglia Screep Done None
In Progress 72087 Kafka partition leader elections causing a drop of a few log lines Screep Done None
In Progress 95494 Grant Sati access to geowiki Screep Done None
In Progress 142101 Add analytics team members to group aqs-admins to be able to deploy pageview APi Screep Done None
In Progress 95505 generate monthly Pageview cubes Screep Done None
In Progress 95550 Install numpy on the cluster Screep Done None
In Progress 95781 EL graphite data missing from 24/3 to 7/4 Screep Done None
In Progress 142410 Correct cache_status field on webrequest dataset Screep Done None
In Progress 95836 Junk in wmf.webrequest.uri_host field Screep Done None
In Progress 96169 Backfill pageview data for March 2015 from sampled logs before transition to UDF-based reports as of April Screep Done None
In Progress 96376 Add better detection of wikipediaApp to user agent UDF {hawk} Screep Done None
In Progress 96921 puppet agent disabled on beta cluster deployment-eventlogging02.eqiad.wmflabs instance Screep Done None
In Progress 143828 ResearchSpike: Pivot UI: react, plywood Screep Done 1.0
In Progress 96926 Add support for X-WMF-UUID method of transmitting app install ID to apps uniques reports [5 pts] {hawk} Screep Done None
In Progress 144119 Add test runner and CI configuration to analytics/reportupdater Screep Done None
In Progress 144278 Queries on PageContentSaveComplete are starting to pileup Screep Done None
In Progress 97344 Provide metrics for WMF quarterly report on January-March 2015 Screep Done None
In Progress 144333 filter suspicious TV channels pageviews from Top Read Screep Done None
In Progress 97351 Fix annoying varnishncsa+initsystem issues on jessie Screep Done None
In Progress 97379 Update http://reportcard.wmflabs.org/ with March 2015 dump data Screep Done None
In Progress 144681 Traffic stats not generating reliably Screep Done None
In Progress 97380 analytics1013 crashed, investigate... Screep Done None
In Progress 97562 WANObjectCache relay daemon or mcrouter support Screep Done None
In Progress 144865 Add pageview stats to the action API Screep Done None
In Progress 97676 Verify kafkatee use for fundraising logs on erbium Screep Done 1.0
In Progress 73056 kafkatee not consuming for some partitions Screep Done None
In Progress 145553 Subscription: Trending service should be able to subscribe to edits in real time Screep Done 3.0
In Progress 145606 Remove cronspam from stat1002 to root@ Screep Done None
In Progress 99105 Kafka Broker disk usage is imbalanced Screep Done None
In Progress 99172 Historical analysis of edit productivity for English Wikipedia Screep Done None
In Progress 146042 Get rid of Pageview-API -> Analytics auto-tagging Screep Done None
In Progress 99967 Update to new page view definition, including breakout of App page views Screep Done None
In Progress 146489 Calculate edit metrics from history reconmstruction in hadoop intermediate table Screep Done 0.0
In Progress 146496 action=history pages should return 404 HTTP error code if the page does not exist Screep Done None
In Progress 100710 Work on Metrics tools wm-metrics and MediaCollectionDB, refactoring and code quality. Screep Done None
In Progress 146815 Some recent ExternalLinksChange data lost Screep Done None
In Progress 74298 Raw webrequest partitions that were not marked successful due to network issues Screep Done None
In Progress 74299 Raw webrequest partitions that were not marked successful due to deployments gone wrong Screep Done None
In Progress 102700 Disable NFS for 'Hadoop' project Screep Done None
In Progress 103301 Puppet does not pass on beta cluster instance deployment-zookeeper01: Could not find class role::analytics::zookeeper::server Screep Done None
In Progress 103304 deployment-kafka02 does not pass puppet: Error 400 on SERVER: $brokers[$::fqdn] is :undef, not a hash or array at /etc/puppet/modules/kafka/manifests/server.pp:194 Screep Done None
In Progress 103376 Deploy oozie reporting of last-access counts {bear} Screep Done None
In Progress 103382 Research & Data offsite Screep Done None
In Progress 103383 Analytics Team offsite Screep Done None
In Progress 148714 Create generalized "precache" endpoint for ORES Screep Done None
In Progress 103385 Reportupdater: put history and pid files inside the project folder [5 pts] {lamb} Screep Done None
In Progress 148780 mobile-safari has very few internally-referred pageviews Screep Done None
In Progress 148842 Put wikistats latest in gerrit Screep Done None
In Progress 103387 Debug blank datafiles generated by generate.py [8 pts] {lamb] Screep Done None
In Progress 103577 Puppetize Piwik to prepare for production deployment Screep Done None
In Progress 149228 Rename stat100x machines to have misc element names Screep Done None
In Progress 149331 Node 6 upgrade planning Screep Done 0.0
In Progress 149408 Asynchronous processing in production: one queue to rule them all Screep Done None
In Progress 74300 Raw webrequest partitions that were not marked successful due to configuration updates Screep Done None
In Progress 104010 Provide summary of MediaWiki downloads Screep Done None
In Progress 149993 sync bohrium and apt.wikimedia.org piwik versions Screep Done None
In Progress 104261 Improve the edit analysis dashboard {lion} Screep Done 8.0
In Progress 104277 Collect HTTP statistics about load.php requests Screep Done None
In Progress 104351 Host a debrief of EventLogging cleanup {tick} Screep Done None
In Progress 105215 Investigate drop-off in global edit save rate starting 27 June 2015 Screep Done None
In Progress 105515 RUBICON Screep Done None
In Progress 105544 Workshop to teach analysts, etc about Quarry, Hive, Wikimetrics and EL {flea} Screep Done None
In Progress 150661 Update Refinery's restart documentation. Screep Done 3.0
In Progress 74649 Raw webrequest partitions that were not marked successful due to depooled servers interfering with monitoring Screep Done None
In Progress 105917 Number of page requests per second for enwiki Screep Done None
In Progress 151896 Install java 8 to stat1002 Screep Done None
In Progress 74809 Raw webrequest partitions that were not marked successful due to only esams caches causing unknown problems Screep Done None
In Progress 106257 Send raw server side events to Kafka using a PHP Kafka Client {oryx} Screep Done 0.0
In Progress 106505 Update http://reportcard.wmflabs.org/ (and Wikistats) with June 2015 dump data Screep Done None
In Progress 75246 THEME: Analyst uses an operationalized Saiku Screep Done None
In Progress 107576 Set up cron job on labstore to rsync data from stat* boxes into labs. Screep Done None
In Progress 107606 What's our projected ability to fundraise in the coming years Screep Done None
In Progress 108386 Kill MediaWiki.authmanager.login.*.failure.<number> statsd buckets Screep Done None
In Progress 153028 EventBus HTTP proxy service's syslog entries should be readable Screep Done None
In Progress 75825 Understand performance & monitor to current capacity- set up tests to identify performance bottleneck (alarm for no writes) Screep Done None
In Progress 153030 400 errors in EventBus Screep Done None
In Progress 153215 Memory leak in Change-Prop Screep Done None
In Progress 108618 Publish detailed Action API request information to Hadoop Screep Done None
In Progress 154265 Replace upstart with systemd unit in eventlogging::devserver and eventlogging::service Screep Done None
In Progress 108684 Transform to XML-->JSON in sorted file format [8 pts] Screep Done None
In Progress 108723 Make MobileWebUIClickTracking schema usable (too big) Screep Done None
In Progress 155066 EventBus produces non-canonical page urls Screep Done None
In Progress 76020 Make upload.wikimedia.org serve images with Timing-Allow-Origin header Screep Done None
In Progress 155487 Open temporary access from analytics vlan to new-labsdb one Screep Done None
In Progress 76035 Investigate if pre-rendering images is having an impact on performance Screep Done None
In Progress 108856 Set up bucketization of editCount fields {tick} Screep Done None
In Progress 109070 Page view statistics looks not updated since 2015-08-13 at 18:00:00 Screep Done None
In Progress 109834 Audit kernel version on analytics worker nodes Screep Done 5.0
In Progress 156411 Compute the trending articles over a period of 24h rather than 1h Screep Done None
In Progress 76334 Network outage on 2014-11-30 affecting analytics infrastructure Screep Done None
In Progress 76342 Fix Varnishkafka delivery error icinga warning Screep Done None
In Progress 76343 Increase HADOOP_HEAPSIZE (-Xmx) for hive-server2 Screep Done 1.0
In Progress 76346 Move stat1001, stat1002 and stat1003 into Analytics VLAN Screep Done None
In Progress 112273 Fix annotation date parsing in Firefox {crow} Screep Done None
In Progress 156986 Requesting access to analytics-privatedata-users for musikanimal Screep Done None
In Progress 76351 Explore usage of Spark with Python and streaming Screep Done None
In Progress 157091 Make EventBus service support wildcards in schema definitions Screep Done None
In Progress 112744 Moving analysis data from flourine to analytics cluster Screep Done None
In Progress 157094 Create schema for Job event Screep Done None
In Progress 157533 Cassandra loading job are causing Pageview stale data Screep Done None
In Progress 76390 After switch to local ssl terminators, pagecounts-raw (C implementation of webstatscollector) overcounts HTTPS from some data-centers. Screep Done None
In Progress 112926 Beta Cluster EventLogging data is disappearing? Screep Done 0.0
In Progress 157943 Analytics cluster should connect to elasticsearch over SSL Screep Done None
In Progress 112947 Nested EventLogging data doesn't get copied to MySQL Screep Done None
In Progress 112956 Developer summit session: Pageview API from the Event Bus perspective Screep Done None
In Progress 61480 Gadget usage statistics for Portuguese Wikipedia Screep Done None
In Progress 76480 Ops has feedback from initial vetting of data in Data Warehouse [13 pts] Screep Done 13.0
In Progress 158310 Serbian Wikipedia edits spike 2016 Screep Done None
In Progress 51266 www.f / foundationwiki (wikimediafoundation.org) pageviews low, underreporting? Screep Done None
In Progress 158451 Kafka logs are not pruned on vagrant Screep Done None
In Progress 158500 Restore previous (January) reports on WikiStats Screep Done None
In Progress 158589 grant access to hue.wikimedia.org to Guillaume Screep Done None
In Progress 158702 Page properties-change event is rejected if page was deleted Screep Done None
In Progress 113931 Pagecount-raw files missing since 27th at 22.00 Screep Done None
In Progress 76795 Product Instrumentation and Visualization {oryx} Screep Done None
In Progress 76803 Analytics Eng has capacity & monitoring for EventLogging {oryx} Screep Done None
In Progress 114427 removed user handrade from access Screep Done None
In Progress 114443 EventBus MVP Screep Done None
In Progress 64848 Number of Wikipedia Zero increasing drastically in mid March 2014 Screep Done None
In Progress 114503 Spike: Can we have a production Event Logging endpoint from labs? Screep Done None
In Progress 114556 Icinga configuration broken by aqs Screep Done None
In Progress 114733 Determine proper encoding for structured log data sent to Kafka by MediaWiki Screep Done None
In Progress 114742 restbase is not listening on port 7231 on aqs* Screep Done None
In Progress 159632 Analytics1028 hdfs daemon died because of disk errors Screep Done None
In Progress 159838 EQIAD: stat1002 replacement Screep Done None
In Progress 159839 EQIAD: stat1003 replacement Screep Done None
In Progress 76921 http://edit-reportcard.wmflabs.org/ doesn't seem to be getting updates (cron job not running yet?) Screep Done None
In Progress 114901 Oozie sends emails when any job fails {hawk} Screep Done None
In Progress 160030 old revision length missing in /v2/stream/recentchange Screep Done 0.0
In Progress 114918 Security review of Analytics Query Service Screep Done None
In Progress 76977 Raw webrequest partitions that were not marked successful due to single message being missing for unknown reason Screep Done None
In Progress 77353 Log loading times directly Screep Done None
In Progress 115588 Automatic monitoring not working for AQS Screep Done None
In Progress 115590 Traffic Breakdown Report - Browser Major Minor Version {lama} Screep Done None
In Progress 160825 Grafana: "wikidata-api" doesn't update anymore Screep Done None
In Progress 160886 Investigate recent Kafka Burrow alarms for EventLogging Screep Done None
In Progress 160942 Create mediawiki.page-restrictions-change event Screep Done None
In Progress 115591 Traffic Breakdown Report - Client OS Major Minor Version {lama} Screep Done None
In Progress 115592 Traffic Breakdown Report - Google Requests {lama} Screep Done None
In Progress 115594 Traffic Breakdown Report - Mime Type {lama} Screep Done None
In Progress 115595 Traffic Breakdown Report - Target Wiki {lama} Screep Done None
In Progress 507 Measure how many users have CORS-hostile proxies Screep Done 0.0
In Progress 161187 Pivot data quality query: Number of logged-in event-editors has three massive peaks in late November 2016 Screep Done None
In Progress 161597 Decom/Reclaim analytics1027 Screep Done 3.0
In Progress 115596 Traffic Breakdown Report - Crawlers {lama} Screep Done None
In Progress 115599 Traffic Breakdown Report - User Agent Overview {lama} Screep Done None
In Progress 115601 Traffic Breakdown Report - User Agents Trend {lama} Screep Done None
In Progress 115602 Traffic Breakdown Report - Browser Trend {lama} Screep Done None
In Progress 115605 Traffic Breakdown Report - Visiting Country {lama} Screep Done None
In Progress 115607 Traffic Breakdown Report - Visiting Country per Wiki {lama} Screep Done None
In Progress 115608 Traffic Breakdown Report - Visiting Country per Wikipedia Language {lama} Screep Done None
In Progress 115609 Traffic Breakdown Report - Visiting Country per Wiki Trend {lama} Screep Done None
In Progress 115610 Traffic Breakdown Report - Browsers from Visiting Country {lama} Screep Done None
In Progress 115612 Traffic Breakdown Report - Device by Site from Visiting Country {lama} Screep Done None
In Progress 115613 Traffic Breakdown Report - Client OS from Visiting Country {lama} Screep Done None
In Progress 77354 Show loading time charts on the dashboard Screep Done None
In Progress 115703 vagrant role that installs kafka in vagrant so users can test monolog in mediawiki Screep Done None
In Progress 116007 Add basic jenkins linting to analytics-limn-wikidata-data Screep Done None
In Progress 77436 Add .gitreview files to new repos Screep Done None
In Progress 77541 Per-file view stats Screep Done None
In Progress 116245 Set up LVS for AQS Screep Done None
In Progress 116247 Define edit related events for change propagation Screep Done None
In Progress 116308 Support Piwik in production Screep Done None
In Progress 77670 Viewing Options Dashboards Screep Done None
In Progress 77739 Log descriptionless file occurrences in MMV Screep Done None
In Progress 116590 AQS cluster Grafana dashboards Screep Done None
In Progress 164178 Investigation: How can we improve the speed of the popular pages bot Screep Done 3.0
In Progress 116609 View counts in squid logs, webstatscollector 2.0 and hive are very dissimilar for several projects. [5 pts] Screep Done None
In Progress 78312 Update the SQL queries for the new versions of the schemas Screep Done None
In Progress 116661 Capacity planning for cluster Screep Done None
In Progress 78355 Engineer finds events that fail validation as early as possible {oryx} Screep Done None
In Progress 116800 Impression log parsers should get sample rate from filenames Screep Done None
In Progress 117008 Data Store hardware procurement - 2015 Screep Done None
In Progress 78539 find out what browsers Wikimedia projects editors use Screep Done None
In Progress 78767 Add Last-Modified to performance logging Screep Done None
In Progress 84852 Update network performance schema queries Screep Done None
In Progress 117242 Inspect Pageview API queries (after launch ) {slug} Screep Done None
In Progress 84923 Reliable publish / subscribe event bus Screep Done None
In Progress 84990 Allow stat1003 to connect to x1-analytics-slave.eqiad.wmnet Screep Done None
In Progress 85250 Update Multimedia dashboards to use datasets.wikimedia.org instead of stat1001.wikimedia.org Screep Done None
In Progress 118155 Decide how to deploy avro schemas in hive (CirrusSearchRequestSet) Screep Done None
In Progress 85698 analytics-logbot is no longer in the #wikimedia-analytics channel Screep Done None
In Progress 165678 clientIP needs to be collected as part of the schema or ... Screep Done None
In Progress 118365 Increase request limits for GETs to /api/rest_v1/ Screep Done None
In Progress 166194 Database replication issues with deleted pages (affecting Tool Labs and Analytics Store) Screep Done None
In Progress 85704 Raw webrequest partitions that were not marked successful due to oozie being overwhelmed Screep Done None
In Progress 118501 Audit Hadoop worker memory usage. Screep Done None
In Progress 118519 wikimedia.org/api and wikimedia.org/api/rest_v1 should redirect to the docs Screep Done None
In Progress 118613 FR tech hadoop onboarding {flea} Screep Done None
In Progress 86135 Epic: qchris transition Screep Done None
In Progress 166391 Analytics access request Screep Done None
In Progress 166405 Monitor if/when mediawiki history reconstruction partitions and imports fall out of sync Screep Done None
In Progress 118817 Wikimedia pageview API intermittently throwing HTTP 503s Screep Done None
In Progress 86136 Story: Analytics Eng can monitor database replication lag Screep Done None
In Progress 86205 udp2log: Announce new stream so people can compare streams Screep Done None
In Progress 86656 Deprecate HTTPS udp2log stream? Screep Done None
In Progress 86675 Fix filter differentiating between varnish hits and misses in performance queries Screep Done None
In Progress 119291 Pageview API demo doesn't list be-tarask Screep Done None
In Progress 86745 Eventlogging file logging code split weirdly between role and base class Screep Done None
In Progress 86763 Puppetized SSH setup of stats user from stat1003 Screep Done None
In Progress 86973 Firewall changes on 2015-01-13 affect udp2log Screep Done None
In Progress 87206 Hadoop logs on logstash are being really spammy Screep Done None
In Progress 167199 Requesting access to the nda LDAP group for GoranSMilovanovic Screep Done None
In Progress 87603 Add time range selection to Dashiki dashboards Screep Done None
In Progress 64873 [Story] Statistics for Wikidata API usage Screep Done None
In Progress 87682 Add pageview counter to wikimetrics/dashiki/dashboards/any tool we own on labs Screep Done None
In Progress 120452 Allow structured datasets on a central repository (CSV, TSV, JSON, GeoJSON, XML, ...) Screep Done None
In Progress 167670 Expose revision-create in EventStreams Screep Done 2.0
In Progress 87912 Convert EventLogging to use extension registration Screep Done None
In Progress 167797 analytics1067: Broken BBU Screep Done None
In Progress 120841 Create fake data for beta AQS deployment Screep Done None
In Progress 167952 analytics-privatedata-users access for ema Screep Done None
In Progress 88027 Apply Schema:Edit instrumentation to WikiEditor Screep Done 8.0
In Progress 88121 active user statistics that have less lag than wikistats Screep Done None
In Progress 88373 Build high level timeseries view of key metrics (save / ready rate) in Dashiki Screep Done None
In Progress 121277 Create Pageview API dashboard to monitor response times Screep Done None
In Progress 168564 deployment-kafka01 / partition is full Screep Done None
In Progress 88374 Build low level visualization of the paths through the application (starburst) in Dashiki Screep Done None
In Progress 121483 Camus not reading in CirrusSearchRequestSet events with the new schema identifier and schema version Screep Done None
In Progress 88646 {Spike} Design where to specify purge schedule for schema {oryx} Screep Done None
In Progress 121643 Change analytics kafka cluster JMX metrics to be prefixed with cluster name and change alerts and dashboards [5 pts] Screep Done None
In Progress 169303 Archive analytics/kraken git repository Screep Done None
In Progress 88692 Backfill event logging data after 02/05 outage Screep Done None
In Progress 122059 update comScore description on report card Screep Done None
In Progress 69804 Story: AnalyticsEng has hourly PageView counts {hawk} Screep Done None
In Progress 122325 add mforns, milimetric, nuria,ottomata, madhuvishy and joal to piwik-roots Screep Done None
In Progress 122479 schedule a daily run of ContentTranslation analytics scripts Screep Done None
In Progress 122494 Add daily totals to grafana maps graph Screep Done None
In Progress 122524 Add amire80 to analytics-privatedata-users group Screep Done None
In Progress 122936 give DFoy access to Hue Screep Done None
In Progress 123200 python-mwviews does not handle unicode in titles Screep Done None
In Progress 123262 Move IOS team piwiki usage to production instance Screep Done None
In Progress 123477 Daily/monthly aggregation of hourly page view files halted Screep Done None
In Progress 123546 Possible bad mem chip or slot on dbproxy1004 Screep Done None
In Progress 123640 Find performance thresholds of piwik production instance Screep Done None
In Progress 123725 Migrate titanium to jessie (archiva.wikimedia.org upgrade) Screep Done None
In Progress 123952 Remove comScore from reportcard Screep Done None
In Progress 88844 Report Total pageviews (new definition) in 2014 Oct-Dec Screep Done None
In Progress 88849 Review EL requests from Mediaviewer Screep Done None
In Progress 89024 Report metrics for Quarterly Report 2014 Oct-Dec Screep Done None
In Progress 124438 Continuous Integration for mediawiki/event-schemas Screep Done None
In Progress 124947 eqiad: (3) AQS replacement nodes Screep Done None
In Progress 89088 Set up varnish 204 beacon endpoint for virtual media views and use it in Media Viewer Screep Done 1.0
In Progress 125128 analytics specific icinga alerts should ping in our IRC channel. Screep Done 5.0
In Progress 89276 Report Signups in 2014 Oct-Dec Screep Done None
In Progress 89277 Report New editors per month in 2014 Oct-Dec Screep Done None
In Progress 125409 Upgrade Dashiki to semantic-2 for all layouts Screep Done None
In Progress 125488 Create directory for output of discovery analytics data in HDFS Screep Done None
In Progress 125650 Data integrity on Analytics Kafka nodes Screep Done None
In Progress 89281 Report visitors (comScore) in 2014 Oct-Dec Screep Done None
In Progress 125856 Visualization of Zika access by geography Screep Done None
In Progress 89283 Report New articles for 2014 Oct-Dec Screep Done None
In Progress 126247 Get piwik stats for dashiki Screep Done None
In Progress 89284 Report Edits for 2014 Oct-Dec Screep Done None
In Progress 70302 role::hadoop will not provision on Ubuntu 14.04 (MediaWiki-Vagrant default) Screep Done None
In Progress 89447 Foundation-only geowiki data trapped in redirection loops Screep Done None
In Progress 126294 Separate AQS off of RESTBase Screep Done 5.0
In Progress 70937 Turn on PHP on stat servers Screep Done None
In Progress 89486 Wikimania submissions Screep Done None
In Progress 126579 Total page view numbers on Wikistats do not match new page view definition Screep Done None
In Progress 126929 Better error messages on pageview API Screep Done None
In Progress 89487 Knowledge Gaps in Wikipedia Screep Done None
In Progress 127720 Allow aqs-admins to deploy via scap using deploy-service ssh key Screep Done None
In Progress 127808 access for nikerabbit to researchers Screep Done None
In Progress 89488 Missing Links in Wikipedia Screep Done None
In Progress 89533 Get rid of artifical click delay in MediaViewer Screep Done 0.0
In Progress 70963 Epic: Webstats Collector is replaced in Refinery Screep Done None
In Progress 128587 http://dumps.wikimedia.org should redirect to https:// Screep Done None
In Progress 128609 RFC: Update profile URLs in content types to point to format documentation Screep Done None
In Progress 89771 pagecounts stats are behind by about 16 hours Screep Done None
In Progress 128804 Kill all unnecessary NFS usage in the analytics project Screep Done None
In Progress 128870 Draft announcement for wikistats transition plan Screep Done None
In Progress 129346 Unable to get pageviews for the title with ' in the name Screep Done None
In Progress 129425 Capture hovercards fetches as previews in analytics Screep Done 2.0
In Progress 129602 Deploy WikimediaPageViewInfo extension to beta cluster Screep Done None
In Progress 129889 Create mediawiki_ApiAction Kafka topic Screep Done None
In Progress 130102 [Task] dashboard showing browser usage distribution for Wikidata Screep Done None
In Progress 130252 Make Unique Devices Dataset Public Screep Done None
In Progress 161186 Pivot "MediaWiki history" data lake: Feature request for "Time" dimension to sp\lit by calendar month / quarter / year -- needs druid 0.10 Screep Open None
In Progress 6537 Categories created using Tamil words not recognised in stats Screep Open None
In Progress 44360 Provide regular cross-wiki reports on flagged revisions status Screep Open None
In Progress 58575 Browser and platform stats for logged-in vs. anon users for security and product support decisions Screep Open None
In Progress 61832 Remove ad-hoc UA logging from existing schemas Screep Open None
In Progress 71145 Story: AnalyticsEng has editor_day table in labsdb Screep Open None
In Progress 71462 Wikimetrics is not supporting mlwiki cohort Screep Open None
In Progress 76432 Validate JsonSchemaContent using MediaWIki core's handling Screep Open None
In Progress 76782 security review of Wikimetrics {dove} Screep Open None
In Progress 76914 User reads result of validation after creating a cohort Screep Open None
In Progress 87604 Add ops-reportcard dashboard with analysis that shows the http to https slowdown on russian wikipedia Screep Open None
In Progress 88775 Add mediacounts to pageview API Screep Open None
In Progress 89397 Investigate getting redirect_page_id as an x_analytics field using the X analytics extension. {pika} Screep Open None
In Progress 89453 Hand off of Christian's MaxMind geolocation databases repository Screep Open None
In Progress 89726 Analyze difference in Edit Schema "bounce rates" across wikis {lion} Screep Open None
In Progress 90240 Could it be that the geo IP matching is not accurate for Africa? Screep Open None
In Progress 90759 Create Daily & Monthly pageview dump with country data Screep Open None
In Progress 92502 Dashboard Directory Design Feedback Screep Open None
In Progress 92875 Add page_id and namespace to X-Analytics header in App / api requests Screep Open None
In Progress 93217 Troubleshoot Wikimetrics RAE reports Screep Open None
In Progress 95456 "Create Report" button does not appear when uploading a new cohort Screep Open None
In Progress 98831 Honor DNT header for access logs & varnish logs Screep Open None
In Progress 102079 Metrics about the use of the Wikimedia web APIs Screep Open None
In Progress 102476 RFC: Requirements for change propagation Screep Open None
In Progress 103726 Report page views for labs instances Screep Open None
In Progress 105815 Pipeline for data-intensive applications from research to productization to integration Screep Open None
In Progress 106034 Too few page views for June/July 2015 Screep Open None
In Progress 107250 Remove links in wikistats to minnan.wikipedia.org Screep Open None
In Progress 108414 Load API request count and latency data from Hadoop to a dashboard Screep Open None
In Progress 108757 Allow opting out from logging some of the default EventLogging fields on a schema-by-schema basis Screep Open None
In Progress 108850 Set up auto-purging after 90 days {tick} Screep Open None
In Progress 110459 Allow clicking on links in annotations Screep Open None
In Progress 110903 Make webperf eventlogging consumers use eventlogging on Kafka Screep Open None
In Progress 111611 Accented letters seem to be rejected in cohort names Screep Open None
In Progress 112009 Re-baselining checkpoints periodically Screep Open None
In Progress 112284 Create new table for 'referer' aggregated data Screep Open None
In Progress 112846 Display automata and humans separately on zero results rate graph Screep Open None
In Progress 113234 Update passport-mediawiki module URLs and documentation Screep Open None
In Progress 113695 Clean the code review queue of analytics/wikistats Screep Open None
In Progress 113817 Connect Hadoop records of the same request coming via different channels Screep Open None
In Progress 114162 Make sunburst and stacked-bars resize with window {crow} Screep Open 3.0
In Progress 114199 Upgrade eventlogging servers to Jessie Screep Open None
In Progress 114469 Investigate US traffic by state normalized by population Screep Open None
In Progress 114884 Some special characters break Wikimetrics' encoding {dove} Screep Open None
In Progress 115042 Make banner impression counts available somewhere public Screep Open None
In Progress 115119 Implement Schema:ExternalLinksChange Screep Open None
In Progress 115634 --- Items above are triaged ----------------------- Screep Open None
In Progress 116188 Add help page in wikitech on what the analytics team can do for you similar to release engineering page Screep Open None
In Progress 116206 Set up AQS in Beta Screep Open None
In Progress 116387 Refactor webrequest_source partitions and oozie jobs Screep Open None
In Progress 116578 Fix layout of the daily email that sends pageview dataset status Screep Open None
In Progress 116658 Add Application errors for Mediawiki API to x-analytics Screep Open None
In Progress 116678 Country mapping routine for proxied requests Screep Open None
In Progress 117018 Fix the pageview API "top" spec and 404 reporting {slug} Screep Open None
In Progress 117221 [Epic] Update official Wikimedia press kit with accurate numbers Screep Open None
In Progress 117236 Track overall traffic, without any filtering, broken down into major categories, for internal use. Screep Open None
In Progress 117290 Create a tool that can read the elements of a wiki template and call the API {kudu} Screep Open None
In Progress 117480 Provide machine readable directory indexes on http://datasets.wikimedia.org/aggregate-datasets/ Screep Open None
In Progress 117945 Investigate anomalous views to pages with replacement characters Screep Open None
In Progress 118310 Expose the results of the global metric at a public link, that's available immediately for the API {kudu} Screep Open 8.0
In Progress 118402 Make AQS return 0 instead of no values {slug} Screep Open None
In Progress 118772 Use scap3 to deploy eventlogging/eventlogging Screep Open 21.0
In Progress 118839 Productionize Pageview_sanitization hive code with Oozie job and refinery inclusion {hawk} Screep Open 8.0
In Progress 118841 Deploy pageview sanitization and start ongoing process {hawk} Screep Open 5.0
In Progress 118842 Backfill pageview_hourly sanitization - 1 month - {hawk} - DUPLICATE THIS TASK FOR EACH MONTH TO BACKFILL Screep Open 8.0
In Progress 119094 Expose pageview data in each project's REST API Screep Open None
In Progress 119772 Create dashboard showing MediaWiki tarball download statistics Screep Open None
In Progress 119897 Create cron on 1002 to remove CirrusSearchRequest partitions Screep Open None
In Progress 119996 Have dashiki read and write GET params to pass stateful versions of dashboard pages {crow} Screep Open None
In Progress 120036 Vital Signs: Please make the data for enwiki and other big wikis less sad, and not just be missing for most days Screep Open None
In Progress 120037 Vital Signs: Please provide an "all languages" de-duplicated stream for the Community/Content groups of metrics Screep Open None
In Progress 120249 Define what constitutes a search pageview Screep Open None
In Progress 120330 Bot to call global metrics to event page {kudu} Screep Open None
In Progress 120713 delete useless wikimetrics.report or cohort records Screep Open None
In Progress 120852 Send burrow lag statistics to statsd/graphite {hawk} Screep Open None
In Progress 121136 Establish a process to periodically review and approve access for hadoop/hue users Screep Open None
In Progress 121262 Display global metrics report results on same page as report inputs {kudu} Screep Open None
In Progress 121286 Central repository of global metrics reports {kudu} Screep Open None
In Progress 121561 Encrypt Kafka traffic, and restrict access via ACLs Screep Open 0.0
In Progress 121912 Better redirect handling for pageview API Screep Open None
In Progress 122245 REST API entry point web request statistics at the Varnish level Screep Open None
In Progress 123958 Consider scrapping Schema:PageContentSaveComplete and Schema:NewEditorEdit, given we have Schema:Edit Screep Open None
In Progress 124082 As an end-user I shouldn't see non-articles in the list of top articles Screep Open None
In Progress 124319 Add json linting test for schemas in mediawiki/event-schemas Screep Open None
In Progress 125015 Requests to (hard) redirect pages return their target's contents but are counted as pageviews to the redirect page Screep Open None
In Progress 125345 Many error 500 from pageviews API "Error in Cassandra table storage backend" Screep Open None
In Progress 125394 Ensure that EventBus extension gracefully handles service failures Screep Open None
In Progress 125829 Potentially decrease db1046's InnoDB buffer pool Screep Open None
In Progress 126218 Replicate wikitech wikis to analytics-store.eqiad.wmnet Screep Open None
In Progress 126279 Add pivot parameter to tabular layout graphs {lama} Screep Open None
In Progress 126281 [Regression] stats.wikipedia.org redirect no longer works ("Domain not served here") Screep Open None
In Progress 126290 Improve joining mechanism between webrequest data and edit data for i.e. sampling pageviews Screep Open None
In Progress 126494 Look into encrypting logs sent between mediawiki app servers and kafka Screep Open None
In Progress 126501 Load Avro schemas from configurable external path Screep Open 13.0
In Progress 127571 Percentage of users with DNT on Screep Open None
In Progress 127850 Improve Hue user management Screep Open None
In Progress 127995 Create table in hive with a continent lookup for countries Screep Open None
In Progress 128374 Sort out analytics service dependency issues for cp* cache hosts Screep Open None
In Progress 128623 Purge all Schema:Echo data after 90 days Screep Open None
In Progress 130832 cdh::hadoop::directory (and other hdfs puppet command?) should quickly check if namenode is active before executing Screep Open None
In Progress 131127 Browser Reports. Break down "Other" bucket a little more? Screep Open None
In Progress 131158 Describe threat model for sanitized pageview data {mole} Screep Open 13.0
In Progress 131280 Making geowiki data public Screep Open None
In Progress 131773 Making tests environment for pageview API deployments Screep Open None
In Progress 131782 Put data needed for edits metrics through Event Bus into HDFS Screep Open None
In Progress 131889 geowiki data for Global Innovation Index Screep Open None
In Progress 131938 Evaluate whether to rewrite varnishkafka in python Screep Open None
In Progress 132405 Collect information about how we collect user statistics in one place Screep Open None
In Progress 132691 Clean up property passing in dashiki Screep Open None
In Progress 133407 fundraising-tech request: browser version breakdown by country Screep Open None
In Progress 133575 Provide weekly top pageviews stats Screep Open None
In Progress 134231 Wikipedia Clickstream dataset. Programmatic Access Screep Open None
In Progress 134524 Pageview API: Limit (and document) size of data you can request Screep Open None
In Progress 135174 Move contents of ee-dashboards to edit-analysis.wmflabs.org Screep Open None
In Progress 135762 A/B Testing solid framework Screep Open None
In Progress 135812 20160431 produces "end timestamp is invalid, must be a valid date in YYYYMMDD format" Screep Open None
In Progress 136025 Simplify readiness checking by making a ready computed Screep Open None
In Progress 136125 Dashiki, Unique Devices and Pageview data breakdown doesn't work if any of the items are not available for the project Screep Open None
In Progress 136126 Better menu for metrics Screep Open None
In Progress 136127 Breakdowns should be bookmarkeable Screep Open None
In Progress 136732 Puppetize job that saves old versions of geoIP database Screep Open None
In Progress 136858 Beeline does not print full stack traces when a query fails {hawk} Screep Open None
In Progress 137321 Run ETL for wmf_raw.ActionApi into wmf.action_* aggregate tables Screep Open None
In Progress 137454 Bot from an Azure cloud cluster is causing a false pageview spike (can we identify as bot?) Screep Open 8.0
In Progress 138207 [Open question] Improve bot identification at scale Screep Open None
In Progress 138396 Create ops dashboard with info like ipv6 traffic split Screep Open None
In Progress 138426 Spike: Evaluate alternatives to varnishkafka: varnishevents Screep Open None
In Progress 138505 Split opera mini in proxy or turbo mode Screep Open None
In Progress 139019 statistics about edit conflicts according to page type Screep Open None
In Progress 139487 Get 'sparklyr' working on stats1005 Screep Open None
In Progress 141010 Adding top counts for wiki projects (ex: WikiProject:Medicine) to pageview API Screep Open 21.0
In Progress 141117 Report on Wikimedia's industry ranking Screep Open None
In Progress 141506 Suddenly outrageous higher pageviews for main pages Screep Open None
In Progress 142073 Improve user management for AQS Screep Open 5.0
In Progress 142139 Top API user agents stats Screep Open None
In Progress 142395 Improve initial load performance for dashiki dashboards Screep Open None
In Progress 142408 Better publishing of Annotations about Data Issues Screep Open None
In Progress 142535 Find out what happens to the old rows in the revision table Screep Open None
In Progress 143689 Bookmarkable date filters for browser stats dashboard Screep Open None
In Progress 143743 Set up the foundation for the ReviewStream feed Screep Open None
In Progress 143819 Data request for logs from SparQL interface at query.wikidata.org Screep Open None
In Progress 144100 Pageview dumps incorrectly formatted, looks like a result of possibly malicious activity Screep Open None
In Progress 144299 Dashboards working on mobile Screep Open None
In Progress 144637 Check eventbus Kafka cluster settings for reliability Screep Open None
In Progress 144639 Propose metrics along with qualifiers for the press kit Screep Open None
In Progress 144714 [REQUEST] Extract search queries from HTTP_REFERER field for a Wikibook Screep Open None
In Progress 144837 Investigate lowering "per-article" resolution data in AQS Screep Open None
In Progress 145164 Add fields needed by ERI to mediawiki.revision-create Screep Open None
In Progress 145197 WMF pageview API (404 error) when requesting statitsics over around 1000 files on GLAMorgan Screep Open None
In Progress 145828 passport-mediawiki-oauth doesn't support callback parameter Screep Open None
In Progress 145935 Responses on pageview API should be lighter Screep Open None
In Progress 146130 Inconsistent Cassandra disk load shown in metrics and nodetool status Screep Open None
In Progress 146774 Add external link to tabs layout Screep Open None
In Progress 146911 Quantify false positives when filtering for number of distinct user agents per page in top pages computation Screep Open None
In Progress 147009 Create a Universal Layout for Dashiki for staging / testing config purposes Screep Open None
In Progress 147196 EventLogging sees MobileWikiAppFindInPage parsing errors Screep Open None
In Progress 147967 The WMF-Last-Access Set-Cookie header should follow RFC 2965 syntax rather than the pre-RFC Netscape format Screep Open None
In Progress 148053 Switch to fetch away from jquery Screep Open 13.0
In Progress 148461 Bot Identification: Inconsistent data in #all-sites-by-os-and-browser for IE7 Screep Open 3.0
In Progress 148469 Just an idea: poly-graph Screep Open None
In Progress 148656 Edit analysis dashboard Failures by User Type chart does not update correctly Screep Open None
In Progress 148776 Screen cast for how to use Pivot (5 minutes) Screep Open 5.0
In Progress 148843 GPU upgrade for stats machine Screep Open None
In Progress 149178 Non existing article is one of the most viewed according to the data returned by the /metrics/pageviews/top/ API Screep Open 3.0
In Progress 149594 Delete stale topics from main Kafka clusters Screep Open None
In Progress 149736 Bikeshed what events should be exposed in public EventStreams API Screep Open 0.0
In Progress 150028 RFC: Requirements for analytics stats processor Screep Open None
In Progress 150106 Type collisions in log events causing indexing failures in ELK Elasticsearch Screep Open None
In Progress 150343 Puppetize clickhouse Screep Open 8.0
In Progress 150369 Record an event every time a new content namespace page is created Screep Open 5.0
In Progress 150439 Tests for swagger spec stream routes in EventStreams Screep Open 5.0
In Progress 150483 Set up a fake Pageview API endpoint for the beta cluster Screep Open None
In Progress 150713 Provide filterable line graph for browser-family/browser-major Screep Open None
In Progress 151211 kafka alarms audit Screep Open None
In Progress 151904 User limits for stat machines. Limit space on /home dir and possibly /tmp Screep Open None
In Progress 152222 Make aggregated MediaWiki Pingback data publicly available Screep Open None
In Progress 152257 Report updater should support Graphite mapping plugins Screep Open None
In Progress 152522 Prevent notebooks on spark to launch 2 pyspark instances instead of 1 Screep Open None
In Progress 152546 de-duplicate archive records matching revision records in mediawiki_history Screep Open None
In Progress 152731 Implement server side filtering (if we should) Screep Open 8.0
In Progress 152788 Pull data for edit reconstruction from labs Screep Open None
In Progress 153029 EventBus logs don't show up in logstash Screep Open None
In Progress 153702 Update active editor metrics to use consensus definition Screep Open None
In Progress 154912 Is User-Agent data PII when associated with Action API requests? Screep Open None
In Progress 155014 Import 2001 wikipedia data Screep Open None
In Progress 155478 Copy cached API requests from raw webrequests table to ApiAction Screep Open None
In Progress 155497 Measure Community Backlog. Screep Open 0.0
In Progress 155507 Meta-statistics on MediaWiki history reconstruction process Screep Open None
In Progress 155804 log-events topic emitted in EventBus Screep Open None
In Progress 156037 Load cirrussearch data into druid Screep Open None
In Progress 156523 Investigate adding user-friendly testing functionality to Reportupdater Screep Open None
In Progress 156656 Review parent task for any potential pageview definition improvements Screep Open None
In Progress 156657 dashiki should execute tests on jenkins Screep Open None
In Progress 156844 Prep to decommission old dbstore hosts (db1046, db1047) Screep Open None
In Progress 156965 Remove user_agent_map from pageview_hourly long term Screep Open None
In Progress 157088 [EPIC] Develop a JobQueue backend based on EventBus Screep Open None
In Progress 157092 Support per-topic configuration in EventBus service Screep Open None
In Progress 157697 Add error component to Dashiki Screep Open None
In Progress 157705 Kafka mirror maker failures when kafka brokers are restarted Screep Open None
In Progress 157978 Blog post about druid Screep Open 5.0
In Progress 157981 Serve global unique device counts externally Screep Open None
In Progress 158106 Update EventBus RCFeed config to use newly refactored settings Screep Open 0.0
In Progress 158166 Discuss labsdb visibility of rev_text_id and ar_comment Screep Open None
In Progress 158334 Make Spark 2.1 easily available on new CDH5.10 cluster Screep Open None
In Progress 158896 Provide a spark job processing history and text to extract citations diffs Screep Open None
In Progress 158972 productionize ClickStream dataset Screep Open None
In Progress 159046 Track page views by page ID rather than title (handles moved pages) Screep Open None
In Progress 159079 JsonData and EventLogging have multiple classes with the same name Screep Open None
In Progress 159170 Find an alternative query interface for eventlogging on analytics cluster that can replace MariaDB Screep Open None
In Progress 159233 Create dashboard for upload wizard Screep Open None
In Progress 159264 Prototype counting of requests with real time (streaming data) Screep Open None
In Progress 159269 Clean up remaining Dashiki configs on meta Screep Open None
In Progress 159337 Automate refinery jar cleanup Screep Open None
In Progress 159584 Secure hue and other private data access sites with 2FA Screep Open None
In Progress 159840 Alarm on data quality issues Screep Open None
In Progress 159962 Spike: Spark 2.x as cluster default (working with oozie) Screep Open None
In Progress 160311 Sort inconsistency in AQS timestamp behavior Screep Open None
In Progress 160630 Please update Tulu Language(tcy)in Wikipedia Statistics. Screep Open None
In Progress 160644 Eventstreams graphite disk usage Screep Open None
In Progress 160679 Test pushing EventLogging through the ELK stack Screep Open None
In Progress 160822 Filter local IPs before checking for geo info Screep Open None
In Progress 161027 Puppetize event schema topic configuration Screep Open None
In Progress 161146 Provide historical redirect flag in Data Lake edit data Screep Open None
In Progress 161149 Provide edit tags in the Data Lake edit data Screep Open None
In Progress 161185 Pivot "MediaWiki history" data lake: Feature request for "Event Users" Screep Open None
In Progress 161635 Storage for banner history data Screep Open None
In Progress 161731 Create reliable change stream for specific wiki Screep Open None
In Progress 161935 Vagrant git-update error for event logging Screep Open None
In Progress 162308 Eventlogging client needs to support offline events Screep Open None
In Progress 162618 Measure portal pageviews Screep Open None
In Progress 162770 SATA errors for stat1004 in the dmesg Screep Open None
In Progress 162933 Endpoint for average view rate in Pageview API Screep Open None
In Progress 163113 Adding breakdowns to mw edit history reconstruction: wiki projects, categories (cohort) Screep Open None
In Progress 163134 Reportupdater writes a README in the output folder Screep Open None
In Progress 163177 can't compile numpy on stat1004 Screep Open None
In Progress 163229 Review by legal department of text on wikistats site Screep Open 1.0
In Progress 163233 Implement Varnish-level rough ratelimiting Screep Open None
In Progress 163252 Add templating support to reportupdater scripts Screep Open None
In Progress 163379 Create JobQueue implementation that posts to EventBus Screep Open None
In Progress 163380 Support posting Jobs to EventBus simultaneously with normal job processing Screep Open None
In Progress 163725 Enable nested on-wiki config pages in mediawiki-storage Screep Open None
In Progress 163789 Investigate whether we could calculate "hourly unique devices" Screep Open None
In Progress 163797 add a more friendly message to ladp authentication box for pivot Screep Open None
In Progress 163908 Monitor more HDFS health metrics Screep Open 3.0
In Progress 163909 Monitor that no worker nodes are in the default rack in net topology Screep Open 3.0
In Progress 163933 Investigate oozie suspended workflows Screep Open None
In Progress 164008 Update druid to latest release Screep Open 13.0
In Progress 164201 AQS unique devices api should report offset/underestimate separately Screep Open None
In Progress 164259 Add VSL error counters to Varnishkafka stats Screep Open None
In Progress 164280 Host API for token persistence dataset Screep Open None
In Progress 164348 Investigate the use of local_quorum for AQS Screep Open 5.0
In Progress 164377 [Spike] Store article quality data inside hadoop and make AQS outputs a public API Screep Open None
In Progress 164500 Add jobs for druid compaction for pageviews data set Screep Open None
In Progress 164593 Provide unqiues estimate/offset breakdowns in AQS Screep Open None
In Progress 164596 Provide uniques offset/underestimate breakdowns in AQS Screep Open None
In Progress 164801 Research and define initial technical requirements for app analytics Screep Open None
In Progress 165233 Data Lake edit data missing for many wikis Screep Open None
In Progress 165309 Create small sample mediawiki-history table in MariaDB Screep Open None
In Progress 165366 rack/setup/install replacement stat1006 (stat1003 replacement) Screep Open None
In Progress 165368 rack/setup/install replacement to stat1005 (stat1002 replacement) Screep Open None
In Progress 165560 Artificial spike in offset of unique devices from November to February 6th on wikidata Screep Open None
In Progress 165634 Add li: Wikibooks to Wikistats Screep Open None
In Progress 165736 Update Varnishkafka to support TLS encryption/authentication Screep Open None
In Progress 166248 Upgrade Analytics Cluster to Java 8 Screep Open None
In Progress 166249 Bulk/Batch event endpoint Screep Open None
In Progress 166331 Pivot - Article Page Views Screep Open None
In Progress 166339 Are watchlists dead? Screep Open None
In Progress 166341 SSDs for main Kafka clusters Screep Open None
In Progress 166414 Explore NavigationTiming by faceted properties - EventLogging refine Screep Open None
In Progress 166679 Reinstate a subset of reports removed from the reportcard until WikiStats 2.0 is back Screep Open None
In Progress 166689 Provide top domain and data to truly test superset Screep Open 8.0
In Progress 166712 Remove logging from labs for schema https://meta.wikimedia.org/wiki/Schema:CommandInvocation Screep Open None
In Progress 166832 Import Kafka messages into HDFS authenticating with TLS/SSL Screep Open 13.0
In Progress 166833 Produce webrequests from varnishkafka to Kafka with Kafka message timestamp set to configurable content field Screep Open None
In Progress 166877 Bring the Editor Engagement Dashboard back Screep Open None
In Progress 166937 Broken /a/refinery-source/guard/run_all_guards.sh script on stat1002 Screep Open None
In Progress 167039 Upgrade Kafka on main cluster with security features Screep Open None
In Progress 167180 Emit revision-score event to EventBus and expose in EventStreams Screep Open None
In Progress 167290 Sqoop wbc_entity_usage from all wikis into hadoop (HDFS) Screep Open None
In Progress 167304 Understand Kafka ACLs and figure out what ACLs we want for production topics Screep Open 8.0
In Progress 167427 Configure superset to query mysql slaves Screep Open 5.0
In Progress 167608 Add caused_by_user_text to mediawiki_page_history Screep Open None
In Progress 167790 Refactor puppet code for the Hadoop Analytics cluster to roles/profiles Screep Open None
In Progress 167907 Incorporate data from the GeoIP2 ISP database to webrequest Screep Open None
In Progress 167992 rack/setup/install new kafka nodes kafka-jumbo100[1-6] Screep Open None
In Progress 168538 Perf test RAID vs JBOD with new hardware and kafka versions Screep Open 5.0
In Progress 168550 Productionize Tranquility (or shut it off) Screep Open None
In Progress 168554 Default hive table creation to parquet - needs hive 2.3.0 Screep Open None
In Progress 168573 Dashiki Cleanup Screep Open None
In Progress 168648 Productionize analysis of editcount vs per_user_revision_count Screep Open None
In Progress 168927 Smartctl errors for one kafka1012 disk Screep Open 3.0
In Progress 169245 Document revision-create event for EventStreams Screep Open 1.0