DMA Analytic Challenge

The 2018 DMA Analytic Challenge is brought to you by the DMA Analytics Community. The DMA Analytics Community organizes this Analytic Challenge, to engage the best analytic experts from around the globe to solve to a challenging business problem. Data practitioners and academicians go “head-to-head” to build advanced analytic models to find compelling solutions to support a real-world marketing challenge.

This Challenge has two objectives:

1. As an industry organization, the DMA focuses on educating the analytic community about analysis, modeling, and data manipulation. The session and Challenge are also intended to teach analytic techniques to event attendees.
2. Recognize companies that achieve superior performance in analytics.

The 2018 Challenge is to build the most accurate model possible. The winners will be selected using mean squared error (lowest) overall, and the quality and clarity of the presentation of the prediction methodology and model development process.

Each participant in the Challenge will receive a data set(s) for model building and validation.

Participants will be required to post a scored validation data set to the competition FTP. This will be used to evaluate solutions and identify the top three solutions. Additional details regarding the evaluation criteria will be provided when the modeling data set is released.

In addition to presenting at the &THEN conference in October (October 7-9) at the MGM Grand in Las Vegas, NV. winners will be invited to present during a future DMA webinar.

1. Overall PowerPoint presentation (no more than ten pages) outlining:
   • the technical results showing the accuracy and performance of the model against the validation data set via charts and accuracy diagnostics
   • the explanation of model algorithm/equation- what predictor variables it contains and their relative importance to prediction
   • what each variable means/how it was developed, and a non -technical explanation of how the overall model predicts the accuracy of customer lifetime value
2. Scoring code must be provided when the scored validation file is submitted
3. Variable creation – variables that were used in the model, need to be traced from input to coefficient / node (if using a tree-based methodology). This includes all recodes, transformations, and summarizations. This information should be presented in a table, with English labels for variables, and equations (if appropriate) for transformations or recodes.

1. Evaluation results – cumulative gains tables – will be reviewed by the Challenge Partner and a subset of the DMA Analytics Community Leadership Council
2. The Judges Panel will identify winning solutions based on criteria that will be specified with the data packet
3. The Panel will not know which companies have won, but will know which models were the winners
4. Winners will be notified in early September

1. The top 3 solutions will be featured during a session at &THEN, DMA’s annual event as well as during the Analytics Community breakfast all taking place October 7-9, 2018 at the MGM Grand in Las Vegas, NV.
2. Each participating company agrees to have a company presenter available at &THEN for the Analytic Challenge session, prepared to present. Note that you will need to register as an attendee for the conference.
3. There will be a check-in for participating companies prior to commencing the session. Any participating company without a presenter will be excluded from the competition at that time.
4. The participating company will be allowed to use company logos in the presentation. However, the presentation will be converted to a standard slide template for presentation consistency purposes. The logo will be included.

Documentation requirements for the final presentation

1. Winners will be notified in early September and must prepare a 7-8 minute presentation for use at the conference session and attend the DMA Analytics Community breakfast, both to be held during DMA’s &THEN Conference, October 7-9, 2018 at the MGM Grand in Las Vegas, NV.in Los Angeles. This presentation must include the following components:

   a) The types of exploratory analyses conducted to select variables used in the model
   b) The steps taken with the raw data provided to convert into modeling variables
   c) Any variable reduction techniques used
   d) The steps undertaken in the modeling process
   e) How the final model was determined to submit for the competition

2. The presentation must be in PowerPoint using the DMA template, and submitted to DMA by Friday, October 1, 2018.
3. All presentations will be reviewed and edited for content and educational components. As such, you may be contacted to review changes. Refusal to reveal educational content will be grounds for removal from the competition. By agreeing to participate, you are agreeing to fully share the steps and methodologies used in your model.

1. As a DMA Conference session, the DMA retains non-exclusive rights to the material presented during the Analytic Challenge session

Questions? Contact Lisa Merizio Smith at lsmith@ana.net.