diff --git a/examples/streamlit/README.md b/examples/streamlit/README.md index a4cb8f9f..a6b3e8c0 100644 --- a/examples/streamlit/README.md +++ b/examples/streamlit/README.md @@ -1,40 +1,8 @@ -# Using W&B and Streamlit +# Examples of using W&B with Streamlit -## Description +Use Streamlit with W&B for quick, interactive apps. +We have two example use cases here in this repo: -Example repo to show off the different possibilties when utilizing both W&B and Streamlit. In this repo we hit two scenarios in terms of interaction with W&B and Streamlit. +1. **Quickstart**: Embed an iframe of W&B in a Streamlit app +2. **Annotation**: Interactively annotate LLM data -1. Embed an IFrame of the WANDB dashboard within the Streamlit application. This is shown in the application when selecting the `Embed IFrame` option. In this variant we allow users to select a project and run. We then display both the project dashboard and run dashboard from WANDB - -2. Use WANDB traiditionally to log artifacts that can be pulled from an experiment to visualize traditionally. This is shown in the application when selecting the `Use WANDB Logging` option. In this variant we provide a minimal example of an WANDB experiment that can be run to the users account upon click. When said experiment is finished, it should load in a logged HTML page saved in WANDB to the file directory of the Streamlit project to then be displayed by Stteamlit. - -## Install - -``` -pip install -r requirements.txt -``` - -Generate a `.env` file in the root of the project with variables: - -``` -WANDB_API_KEY= -WANDB_ENTITY= -``` - -## Usage - -To run streamlit on localhost use command: `streamlit run wandb_streamlit_app.py` - -## Examples - -### WANDB Project Dashboard - - - -### WANDB Run Dashboard - - - -### WANDB HTML Artifact rendered via Streamlit - - diff --git a/examples/streamlit/annotation/Annotation_Streamlit_WB.ipynb b/examples/streamlit/annotation/Annotation_Streamlit_WB.ipynb new file mode 100644 index 00000000..1f0d69d4 --- /dev/null +++ b/examples/streamlit/annotation/Annotation_Streamlit_WB.ipynb @@ -0,0 +1,2860 @@ +{ + "cells": [ + { + "cell_type": "markdown", + "metadata": { + "id": "S-Uf9D78nfrX" + }, + "source": [ + "# Annotations for LLMs with Streamlit and W&B\n", + "\n", + "With [Weights & Biases](https://wandb.ai/site), log inputs and outputs from LLM experiments, then evaluate results. Examine individual prompts and responses at the application scale.\n", + "\n", + "W&B Tables stores these critical assets in a single system of record alongside other artifacts, such as input datasets and model checkpoints, with essential metadata and lineage tracked for transparency and reproducibility.\n", + "\n", + "One smart strategy is revising these assets in a table to improve on model performance. [Streamlit's data editor](https://docs.streamlit.io/library/api-reference/data/st.data_editor), showcased in this application, provides an elegant and flexible solution using W&B Tables. Through the application's UI, annotators can flag outlier model responses, select next steps for refinement, and edit results in-place as needed. All of that can be easily exported and stored as a subsequent artifact to a Weights & Biases LLM development or tuning project.\n", + "\n", + "This notebook walks through one simple approach, with the following steps:\n", + "1. Run automated summary of news articles with Hugging Face [pipelines](https://huggingface.co/docs/transformers/main_classes/pipelines)\n", + "2. Log Tables to W&B to compare two model approaches\n", + "3. Download CSV files of Tables to annotate in Streamlit\n", + "4. Annotate tables with Streamlit data editor\n", + "5. Load annotated Tables to W&B for versioning and evaluation\n", + "\n", + "### 🏁 Let's get started!\n" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "11msJvwtbSMO" + }, + "source": [ + "First, install dependencies for W&B and Hugging Face." + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "JkP6kNsyXVzx" + }, + "outputs": [], + "source": [ + "# Dependencies\n", + "! pip install datasets transformers\n", + "! pip install wandb -qq\n", + "! pip install accelerate -U" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 139 + }, + "id": "BGSdI2XDtOVA", + "outputId": "19703d97-9601-4072-ad30-d3617725aefe" + }, + "outputs": [ + { + "data": { + "application/javascript": "\n window._wandbApiKey = new Promise((resolve, reject) => {\n function loadScript(url) {\n return new Promise(function(resolve, reject) {\n let newScript = document.createElement(\"script\");\n newScript.onerror = reject;\n newScript.onload = resolve;\n document.body.appendChild(newScript);\n newScript.src = url;\n });\n }\n loadScript(\"https://cdn.jsdelivr.net/npm/postmate/build/postmate.min.js\").then(() => {\n const iframe = document.createElement('iframe')\n iframe.style.cssText = \"width:0;height:0;border:none\"\n document.body.appendChild(iframe)\n const handshake = new Postmate({\n container: iframe,\n url: 'https://wandb.ai/authorize'\n });\n const timeout = setTimeout(() => reject(\"Couldn't auto authenticate\"), 5000)\n handshake.then(function(child) {\n child.on('authorize', data => {\n clearTimeout(timeout)\n resolve(data)\n });\n });\n })\n });\n ", + "text/plain": [ + "" + ] + }, + "metadata": {}, + "output_type": "display_data" + }, + { + "name": "stderr", + "output_type": "stream", + "text": [ + "\u001b[34m\u001b[1mwandb\u001b[0m: Logging into wandb.ai. (Learn how to deploy a W&B server locally: https://wandb.me/wandb-server)\n", + "\u001b[34m\u001b[1mwandb\u001b[0m: You can find your API key in your browser here: https://wandb.ai/authorize\n", + "wandb: Paste an API key from your profile and hit enter, or press ctrl+c to quit:" + ] + }, + { + "name": "stdout", + "output_type": "stream", + "text": [ + " ··········\n" + ] + }, + { + "name": "stderr", + "output_type": "stream", + "text": [ + "wandb: Paste an API key from your profile and hit enter, or press ctrl+c to quit:" + ] + }, + { + "name": "stdout", + "output_type": "stream", + "text": [ + " ··········\n" + ] + }, + { + "name": "stderr", + "output_type": "stream", + "text": [ + "\u001b[34m\u001b[1mwandb\u001b[0m: Appending key for api.wandb.ai to your netrc file: /root/.netrc\n" + ] + }, + { + "data": { + "text/plain": [ + "True" + ] + }, + "execution_count": 2, + "metadata": {}, + "output_type": "execute_result" + } + ], + "source": [ + "import pandas as pd\n", + "\n", + "from transformers import pipeline\n", + "from datasets import load_dataset, Dataset\n", + "\n", + "import wandb\n", + "wandb.login()\n", + "\n", + "# import weave\n", + "# # from weave import ops_arrow\n", + "# # from weave.ops_arrow import constructors as arrow_constructors\n", + "# from weave.monitoring import StreamTable\n", + "# import pyarrow as pa" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "K8lQxTtlWV3j" + }, + "source": [ + "##1. Run automated summary of news articles with Hugging Face pipelines\n", + "\n", + "This notebook will use a summarization example to showcase W&B and Streamlit, together. Summarization can serve a lot of important uses in ML pipelines, from assisting in data quality checks to preprocessing long-form data into something digestible for a downstream task, e.g., classification.There are many options out there for generating summaries automatically, but for ease of use we are going with Hugging Face [pipelines](https://huggingface.co/docs/transformers/v4.17.0/en/main_classes/pipelines#transformers.SummarizationPipeline)." + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "gOfSJN4pTVng" + }, + "outputs": [], + "source": [ + "NUM_ARTICLES = 20" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "4lXOLMOzcU0u" + }, + "source": [ + "We will use the tried-and-true CNN/Daily Mail [dataset](https://huggingface.co/datasets/cnn_dailymail) to test out summarization outputs from 2 different pre-trained models from the Hugging Face [model repository](https://huggingface.co/models)." + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "_ld6lWoRTVkp" + }, + "outputs": [], + "source": [ + "cnn_dailymail = load_dataset('cnn_dailymail', '3.0.0')\n", + "\n", + "input_df = cnn_dailymail['train'].to_pandas().sample(frac=1)[:NUM_ARTICLES]\n", + "articles = input_df['article'].values" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "Pm2U9YtiTVh2" + }, + "outputs": [], + "source": [ + "# Define summarizers for 2 different models for comparison\n", + "bart_summarizer = pipeline(\"summarization\", \"facebook/bart-large-cnn\")\n", + "samsum_summarizer = pipeline(\"summarization\", \"philschmid/bart-large-cnn-samsum\")" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "MjU4QCVwTdAL" + }, + "outputs": [], + "source": [ + "# Create dataframe for each group of 20 summaries\n", + "bart_summaries = []\n", + "bart_samsum_summaries = []\n", + "\n", + "for article in articles:\n", + " bart_summaries.append(bart_summarizer(article[:1024])[0][\"summary_text\"])\n", + " bart_samsum_summaries.append(samsum_summarizer(article[:512])[0][\"summary_text\"])" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "5bYJ_MbTTuJP" + }, + "outputs": [], + "source": [ + "bart_df = pd.DataFrame({\n", + " \"articles\": articles,\n", + " \"bart_summaries\": bart_summaries,\n", + "})" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 677 + }, + "id": "HSE46Xm1iMqA", + "outputId": "5fc4e42a-fbe6-4a11-b230-53a7c9abbe2b" + }, + "outputs": [ + { + "data": { + "text/html": [ + "\n", + "
\n", + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
articlesbart_summaries
0By . Chris Parsons . PUBLISHED: . 02:41 EST, 2...Valerie Trierweiler tweeted support for a poli...
1By . Damien Gayle . PUBLISHED: . 08:10 EST, 12...Nasa and Florida Institute for Human and Machi...
2A father who imported a stun gun disguised as ...John Liddiatt, 40, ordered the device online w...
3February 10, 2015 . Economics, international p...This page includes the show Transcript. Use th...
4By . James Rush . PUBLISHED: . 10:51 EST, 5 Ap...Boy, three, two teenagers and a man in his 30s...
5By . Daily Mail Reporter . PUBLISHED: . 19:11 ...Grover J. Prewitt Jr., 60, of Bristow was arre...
6By . James Rush . PUBLISHED: . 06:02 EST, 30 S...Sheik Mohammed bin Rashid Al Maktoum has order...
7By . Sam Webb and Amanda Williams . PUBLISHED:...Six out of the last seven UK summers have seen...
8(CNN) -- When CNN highlighted some excellent h...Tampa's Columbia Restaurant is 107 years old. ...
9(CNN) -- Japanese golf prodigy Ryo Ishikawa ha...Japanese golf prodigy Ryo Ishikawa will donate...
10Warsaw (CNN) -- Eleven people died and one, so...A small aircraft belonging to a private parach...
11By . Associated Press . PUBLISHED: . 09:08 EST...Allegations that male instructors had sex with...
12By . Adam Shergold . PUBLISHED: . 13:08 EST, 5...Matt Prior hits back at Piers Morgan's claims ...
13Once an annual round of exclusive balls, refin...The Queen Charlotte's Ball was held last night...
14(CNN) -- The memory unit that may tell why an ...NEW: Air France says the memory unit is part o...
15By . James Nye . Under mounting pressure to s...The rapper has signed a contract to design an ...
16Police should face time limits on how long a p...Theresa May is demanding action amid mounting ...
17Two Second World War Lancaster bombers flew to...The Lancaster Thumper joined the Canadian Lanc...
18Andy Murray knows there can be no let up in hi...Andy Murray beat David Ferrer 5-7 6-2 7-5 in t...
19A lifelong dream becomes reality for Chris Cor...Chris Cork is set to embark on the 5,500-mile ...
\n", + "
\n", + "
\n", + "\n", + "
\n", + " \n", + "\n", + " \n", + "\n", + " \n", + "
\n", + "\n", + "\n", + "
\n", + " \n", + "\n", + "\n", + "\n", + " \n", + "
\n", + "
\n", + "
\n" + ], + "text/plain": [ + " articles \\\n", + "0 By . Chris Parsons . PUBLISHED: . 02:41 EST, 2... \n", + "1 By . Damien Gayle . PUBLISHED: . 08:10 EST, 12... \n", + "2 A father who imported a stun gun disguised as ... \n", + "3 February 10, 2015 . Economics, international p... \n", + "4 By . James Rush . PUBLISHED: . 10:51 EST, 5 Ap... \n", + "5 By . Daily Mail Reporter . PUBLISHED: . 19:11 ... \n", + "6 By . James Rush . PUBLISHED: . 06:02 EST, 30 S... \n", + "7 By . Sam Webb and Amanda Williams . PUBLISHED:... \n", + "8 (CNN) -- When CNN highlighted some excellent h... \n", + "9 (CNN) -- Japanese golf prodigy Ryo Ishikawa ha... \n", + "10 Warsaw (CNN) -- Eleven people died and one, so... \n", + "11 By . Associated Press . PUBLISHED: . 09:08 EST... \n", + "12 By . Adam Shergold . PUBLISHED: . 13:08 EST, 5... \n", + "13 Once an annual round of exclusive balls, refin... \n", + "14 (CNN) -- The memory unit that may tell why an ... \n", + "15 By . James Nye . Under mounting pressure to s... \n", + "16 Police should face time limits on how long a p... \n", + "17 Two Second World War Lancaster bombers flew to... \n", + "18 Andy Murray knows there can be no let up in hi... \n", + "19 A lifelong dream becomes reality for Chris Cor... \n", + "\n", + " bart_summaries \n", + "0 Valerie Trierweiler tweeted support for a poli... \n", + "1 Nasa and Florida Institute for Human and Machi... \n", + "2 John Liddiatt, 40, ordered the device online w... \n", + "3 This page includes the show Transcript. Use th... \n", + "4 Boy, three, two teenagers and a man in his 30s... \n", + "5 Grover J. Prewitt Jr., 60, of Bristow was arre... \n", + "6 Sheik Mohammed bin Rashid Al Maktoum has order... \n", + "7 Six out of the last seven UK summers have seen... \n", + "8 Tampa's Columbia Restaurant is 107 years old. ... \n", + "9 Japanese golf prodigy Ryo Ishikawa will donate... \n", + "10 A small aircraft belonging to a private parach... \n", + "11 Allegations that male instructors had sex with... \n", + "12 Matt Prior hits back at Piers Morgan's claims ... \n", + "13 The Queen Charlotte's Ball was held last night... \n", + "14 NEW: Air France says the memory unit is part o... \n", + "15 The rapper has signed a contract to design an ... \n", + "16 Theresa May is demanding action amid mounting ... \n", + "17 The Lancaster Thumper joined the Canadian Lanc... \n", + "18 Andy Murray beat David Ferrer 5-7 6-2 7-5 in t... \n", + "19 Chris Cork is set to embark on the 5,500-mile ... " + ] + }, + "execution_count": 9, + "metadata": {}, + "output_type": "execute_result" + } + ], + "source": [ + "bart_df" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "1wWj3MK0Ts4Q" + }, + "outputs": [], + "source": [ + "samsum_df = pd.DataFrame({\n", + " \"articles\": articles,\n", + " \"bart_samsum_summaries\": bart_samsum_summaries,\n", + "})" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 677 + }, + "id": "jPIrQ_fUiNjX", + "outputId": "77c725f5-10b9-4b25-af8c-230b415bc03c" + }, + "outputs": [ + { + "data": { + "text/html": [ + "\n", + "
\n", + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
articlesbart_samsum_summaries
0By . Chris Parsons . PUBLISHED: . 02:41 EST, 2...Segolene Royal lost the presidential election ...
1By . Damien Gayle . PUBLISHED: . 08:10 EST, 12...Nasa and the Florida Institute for Human and M...
2A father who imported a stun gun disguised as ...John Liddiatt, 40, imported a stun gun disguis...
3February 10, 2015 . Economics, international p...This page includes CNN Student News stories on...
4By . James Rush . PUBLISHED: . 10:51 EST, 5 Ap...A three-year-old boy and two other people rema...
5By . Daily Mail Reporter . PUBLISHED: . 19:11 ...Grover J. Prewitt Jr., 60, of Bristow, Oklahom...
6By . James Rush . PUBLISHED: . 06:02 EST, 30 S...Banned equine drugs were found on a Dubai gove...
7By . Sam Webb and Amanda Williams . PUBLISHED:...Met Office experts predict a decade of wet sum...
8(CNN) -- When CNN highlighted some excellent h...Last month, CNN highlighted some excellent his...
9(CNN) -- Japanese golf prodigy Ryo Ishikawa ha...Ryo Ishikawa will donate his tournament earnin...
10Warsaw (CNN) -- Eleven people died and one, so...Eleven people died and one survived when a sma...
11By . Associated Press . PUBLISHED: . 09:08 EST...Col. Glenn Palmer delivered his first order to...
12By . Adam Shergold . PUBLISHED: . 13:08 EST, 5...Matt Prior has hit back at Piers Morgan's clai...
13Once an annual round of exclusive balls, refin...The debutante ball has lost its royal patronag...
14(CNN) -- The memory unit that may tell why an ...The memory unit that may tell why an Air Franc...
15By . James Nye . Under mounting pressure to s...James Nye has released a statement on his webs...
16Police should face time limits on how long a p...Theresa May is demanding action against police...
17Two Second World War Lancaster bombers flew to...Two World War II-era Lancaster bombers flew to...
18Andy Murray knows there can be no let up in hi...Andy Murray beat David Ferrer in the final of ...
19A lifelong dream becomes reality for Chris Cor...Chris Cork will start his Dakar journey in Bue...
\n", + "
\n", + "
\n", + "\n", + "
\n", + " \n", + "\n", + " \n", + "\n", + " \n", + "
\n", + "\n", + "\n", + "
\n", + " \n", + "\n", + "\n", + "\n", + " \n", + "
\n", + "
\n", + "
\n" + ], + "text/plain": [ + " articles \\\n", + "0 By . Chris Parsons . PUBLISHED: . 02:41 EST, 2... \n", + "1 By . Damien Gayle . PUBLISHED: . 08:10 EST, 12... \n", + "2 A father who imported a stun gun disguised as ... \n", + "3 February 10, 2015 . Economics, international p... \n", + "4 By . James Rush . PUBLISHED: . 10:51 EST, 5 Ap... \n", + "5 By . Daily Mail Reporter . PUBLISHED: . 19:11 ... \n", + "6 By . James Rush . PUBLISHED: . 06:02 EST, 30 S... \n", + "7 By . Sam Webb and Amanda Williams . PUBLISHED:... \n", + "8 (CNN) -- When CNN highlighted some excellent h... \n", + "9 (CNN) -- Japanese golf prodigy Ryo Ishikawa ha... \n", + "10 Warsaw (CNN) -- Eleven people died and one, so... \n", + "11 By . Associated Press . PUBLISHED: . 09:08 EST... \n", + "12 By . Adam Shergold . PUBLISHED: . 13:08 EST, 5... \n", + "13 Once an annual round of exclusive balls, refin... \n", + "14 (CNN) -- The memory unit that may tell why an ... \n", + "15 By . James Nye . Under mounting pressure to s... \n", + "16 Police should face time limits on how long a p... \n", + "17 Two Second World War Lancaster bombers flew to... \n", + "18 Andy Murray knows there can be no let up in hi... \n", + "19 A lifelong dream becomes reality for Chris Cor... \n", + "\n", + " bart_samsum_summaries \n", + "0 Segolene Royal lost the presidential election ... \n", + "1 Nasa and the Florida Institute for Human and M... \n", + "2 John Liddiatt, 40, imported a stun gun disguis... \n", + "3 This page includes CNN Student News stories on... \n", + "4 A three-year-old boy and two other people rema... \n", + "5 Grover J. Prewitt Jr., 60, of Bristow, Oklahom... \n", + "6 Banned equine drugs were found on a Dubai gove... \n", + "7 Met Office experts predict a decade of wet sum... \n", + "8 Last month, CNN highlighted some excellent his... \n", + "9 Ryo Ishikawa will donate his tournament earnin... \n", + "10 Eleven people died and one survived when a sma... \n", + "11 Col. Glenn Palmer delivered his first order to... \n", + "12 Matt Prior has hit back at Piers Morgan's clai... \n", + "13 The debutante ball has lost its royal patronag... \n", + "14 The memory unit that may tell why an Air Franc... \n", + "15 James Nye has released a statement on his webs... \n", + "16 Theresa May is demanding action against police... \n", + "17 Two World War II-era Lancaster bombers flew to... \n", + "18 Andy Murray beat David Ferrer in the final of ... \n", + "19 Chris Cork will start his Dakar journey in Bue... " + ] + }, + "execution_count": 11, + "metadata": {}, + "output_type": "execute_result" + } + ], + "source": [ + "samsum_df" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "YfNlCobpTc9T" + }, + "outputs": [], + "source": [ + "# Combine dataframes for logging to W&B\n", + "\n", + "joint_df = pd.DataFrame({\n", + " \"articles\": articles,\n", + " \"bart_summaries\": bart_summaries,\n", + " \"bart_samsum_summaries\": bart_samsum_summaries,\n", + "})" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 677 + }, + "id": "oIO0RyatiPIW", + "outputId": "4cf643d9-38fc-4b9a-9b4e-b04574efcd3c" + }, + "outputs": [ + { + "data": { + "text/html": [ + "\n", + "
\n", + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
articlesbart_summariesbart_samsum_summaries
0By . Chris Parsons . PUBLISHED: . 02:41 EST, 2...Valerie Trierweiler tweeted support for a poli...Segolene Royal lost the presidential election ...
1By . Damien Gayle . PUBLISHED: . 08:10 EST, 12...Nasa and Florida Institute for Human and Machi...Nasa and the Florida Institute for Human and M...
2A father who imported a stun gun disguised as ...John Liddiatt, 40, ordered the device online w...John Liddiatt, 40, imported a stun gun disguis...
3February 10, 2015 . Economics, international p...This page includes the show Transcript. Use th...This page includes CNN Student News stories on...
4By . James Rush . PUBLISHED: . 10:51 EST, 5 Ap...Boy, three, two teenagers and a man in his 30s...A three-year-old boy and two other people rema...
5By . Daily Mail Reporter . PUBLISHED: . 19:11 ...Grover J. Prewitt Jr., 60, of Bristow was arre...Grover J. Prewitt Jr., 60, of Bristow, Oklahom...
6By . James Rush . PUBLISHED: . 06:02 EST, 30 S...Sheik Mohammed bin Rashid Al Maktoum has order...Banned equine drugs were found on a Dubai gove...
7By . Sam Webb and Amanda Williams . PUBLISHED:...Six out of the last seven UK summers have seen...Met Office experts predict a decade of wet sum...
8(CNN) -- When CNN highlighted some excellent h...Tampa's Columbia Restaurant is 107 years old. ...Last month, CNN highlighted some excellent his...
9(CNN) -- Japanese golf prodigy Ryo Ishikawa ha...Japanese golf prodigy Ryo Ishikawa will donate...Ryo Ishikawa will donate his tournament earnin...
10Warsaw (CNN) -- Eleven people died and one, so...A small aircraft belonging to a private parach...Eleven people died and one survived when a sma...
11By . Associated Press . PUBLISHED: . 09:08 EST...Allegations that male instructors had sex with...Col. Glenn Palmer delivered his first order to...
12By . Adam Shergold . PUBLISHED: . 13:08 EST, 5...Matt Prior hits back at Piers Morgan's claims ...Matt Prior has hit back at Piers Morgan's clai...
13Once an annual round of exclusive balls, refin...The Queen Charlotte's Ball was held last night...The debutante ball has lost its royal patronag...
14(CNN) -- The memory unit that may tell why an ...NEW: Air France says the memory unit is part o...The memory unit that may tell why an Air Franc...
15By . James Nye . Under mounting pressure to s...The rapper has signed a contract to design an ...James Nye has released a statement on his webs...
16Police should face time limits on how long a p...Theresa May is demanding action amid mounting ...Theresa May is demanding action against police...
17Two Second World War Lancaster bombers flew to...The Lancaster Thumper joined the Canadian Lanc...Two World War II-era Lancaster bombers flew to...
18Andy Murray knows there can be no let up in hi...Andy Murray beat David Ferrer 5-7 6-2 7-5 in t...Andy Murray beat David Ferrer in the final of ...
19A lifelong dream becomes reality for Chris Cor...Chris Cork is set to embark on the 5,500-mile ...Chris Cork will start his Dakar journey in Bue...
\n", + "
\n", + "
\n", + "\n", + "
\n", + " \n", + "\n", + " \n", + "\n", + " \n", + "
\n", + "\n", + "\n", + "
\n", + " \n", + "\n", + "\n", + "\n", + " \n", + "
\n", + "
\n", + "
\n" + ], + "text/plain": [ + " articles \\\n", + "0 By . Chris Parsons . PUBLISHED: . 02:41 EST, 2... \n", + "1 By . Damien Gayle . PUBLISHED: . 08:10 EST, 12... \n", + "2 A father who imported a stun gun disguised as ... \n", + "3 February 10, 2015 . Economics, international p... \n", + "4 By . James Rush . PUBLISHED: . 10:51 EST, 5 Ap... \n", + "5 By . Daily Mail Reporter . PUBLISHED: . 19:11 ... \n", + "6 By . James Rush . PUBLISHED: . 06:02 EST, 30 S... \n", + "7 By . Sam Webb and Amanda Williams . PUBLISHED:... \n", + "8 (CNN) -- When CNN highlighted some excellent h... \n", + "9 (CNN) -- Japanese golf prodigy Ryo Ishikawa ha... \n", + "10 Warsaw (CNN) -- Eleven people died and one, so... \n", + "11 By . Associated Press . PUBLISHED: . 09:08 EST... \n", + "12 By . Adam Shergold . PUBLISHED: . 13:08 EST, 5... \n", + "13 Once an annual round of exclusive balls, refin... \n", + "14 (CNN) -- The memory unit that may tell why an ... \n", + "15 By . James Nye . Under mounting pressure to s... \n", + "16 Police should face time limits on how long a p... \n", + "17 Two Second World War Lancaster bombers flew to... \n", + "18 Andy Murray knows there can be no let up in hi... \n", + "19 A lifelong dream becomes reality for Chris Cor... \n", + "\n", + " bart_summaries \\\n", + "0 Valerie Trierweiler tweeted support for a poli... \n", + "1 Nasa and Florida Institute for Human and Machi... \n", + "2 John Liddiatt, 40, ordered the device online w... \n", + "3 This page includes the show Transcript. Use th... \n", + "4 Boy, three, two teenagers and a man in his 30s... \n", + "5 Grover J. Prewitt Jr., 60, of Bristow was arre... \n", + "6 Sheik Mohammed bin Rashid Al Maktoum has order... \n", + "7 Six out of the last seven UK summers have seen... \n", + "8 Tampa's Columbia Restaurant is 107 years old. ... \n", + "9 Japanese golf prodigy Ryo Ishikawa will donate... \n", + "10 A small aircraft belonging to a private parach... \n", + "11 Allegations that male instructors had sex with... \n", + "12 Matt Prior hits back at Piers Morgan's claims ... \n", + "13 The Queen Charlotte's Ball was held last night... \n", + "14 NEW: Air France says the memory unit is part o... \n", + "15 The rapper has signed a contract to design an ... \n", + "16 Theresa May is demanding action amid mounting ... \n", + "17 The Lancaster Thumper joined the Canadian Lanc... \n", + "18 Andy Murray beat David Ferrer 5-7 6-2 7-5 in t... \n", + "19 Chris Cork is set to embark on the 5,500-mile ... \n", + "\n", + " bart_samsum_summaries \n", + "0 Segolene Royal lost the presidential election ... \n", + "1 Nasa and the Florida Institute for Human and M... \n", + "2 John Liddiatt, 40, imported a stun gun disguis... \n", + "3 This page includes CNN Student News stories on... \n", + "4 A three-year-old boy and two other people rema... \n", + "5 Grover J. Prewitt Jr., 60, of Bristow, Oklahom... \n", + "6 Banned equine drugs were found on a Dubai gove... \n", + "7 Met Office experts predict a decade of wet sum... \n", + "8 Last month, CNN highlighted some excellent his... \n", + "9 Ryo Ishikawa will donate his tournament earnin... \n", + "10 Eleven people died and one survived when a sma... \n", + "11 Col. Glenn Palmer delivered his first order to... \n", + "12 Matt Prior has hit back at Piers Morgan's clai... \n", + "13 The debutante ball has lost its royal patronag... \n", + "14 The memory unit that may tell why an Air Franc... \n", + "15 James Nye has released a statement on his webs... \n", + "16 Theresa May is demanding action against police... \n", + "17 Two World War II-era Lancaster bombers flew to... \n", + "18 Andy Murray beat David Ferrer in the final of ... \n", + "19 Chris Cork will start his Dakar journey in Bue... " + ] + }, + "execution_count": 13, + "metadata": {}, + "output_type": "execute_result" + } + ], + "source": [ + "joint_df" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "UuqHWjuwdMp5" + }, + "source": [ + "Here, we define a simple word function and [lexical diversity](https://en.wikipedia.org/wiki/Lexical_diversity) function, which can be useful data points for examining text inputs and gauging how completely and fluently summarization outputs capture their \"meaning.\"\n", + "
\n", + "
\n", + "There are many methods and dimensions to consider when evaluating summaries, to a quick vibes check to reference-based metrics (if you are lucky enough to have gold-standard reference summaries 🍀). This walkthrough shows a simple manual approach, where automated summaries are evaluated for further refinement." + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "ftlmADWATc6c" + }, + "outputs": [], + "source": [ + "# Function to calculate word count\n", + "def calculate_word_count(text):\n", + " words = text.split()\n", + " return len(words)\n", + "\n", + "# Function to calculate lexical diversity\n", + "def calculate_lexical_diversity(text):\n", + " words = text.split()\n", + " unique_words = set(words)\n", + " return round((len(unique_words) / len(words)), 3)\n" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 1000 + }, + "id": "NM69E2HITc3W", + "outputId": "f414d726-3a0c-482f-be98-2de788bc2421" + }, + "outputs": [ + { + "data": { + "text/html": [ + "\n", + "
\n", + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
articlesbart_summariessource_word_countsummary_word_countsource_lexical_diversitysummary_lexical_diversity
0By . Chris Parsons . PUBLISHED: . 02:41 EST, 2...Valerie Trierweiler tweeted support for a poli...719400.5170.925
1By . Damien Gayle . PUBLISHED: . 08:10 EST, 12...Nasa and Florida Institute for Human and Machi...853560.5230.857
2A father who imported a stun gun disguised as ...John Liddiatt, 40, ordered the device online w...538540.5070.815
3February 10, 2015 . Economics, international p...This page includes the show Transcript. Use th...239480.6400.833
4By . James Rush . PUBLISHED: . 10:51 EST, 5 Ap...Boy, three, two teenagers and a man in his 30s...581480.5080.938
5By . Daily Mail Reporter . PUBLISHED: . 19:11 ...Grover J. Prewitt Jr., 60, of Bristow was arre...789480.4850.917
6By . James Rush . PUBLISHED: . 06:02 EST, 30 S...Sheik Mohammed bin Rashid Al Maktoum has order...727530.4690.925
7By . Sam Webb and Amanda Williams . PUBLISHED:...Six out of the last seven UK summers have seen...1351590.4320.814
8(CNN) -- When CNN highlighted some excellent h...Tampa's Columbia Restaurant is 107 years old. ...1440480.5780.917
9(CNN) -- Japanese golf prodigy Ryo Ishikawa ha...Japanese golf prodigy Ryo Ishikawa will donate...235490.6510.878
10Warsaw (CNN) -- Eleven people died and one, so...A small aircraft belonging to a private parach...193570.7310.895
11By . Associated Press . PUBLISHED: . 09:08 EST...Allegations that male instructors had sex with...1011470.5330.894
12By . Adam Shergold . PUBLISHED: . 13:08 EST, 5...Matt Prior hits back at Piers Morgan's claims ...598680.5480.824
13Once an annual round of exclusive balls, refin...The Queen Charlotte's Ball was held last night...1022480.4300.875
14(CNN) -- The memory unit that may tell why an ...NEW: Air France says the memory unit is part o...468540.6110.833
15By . James Nye . Under mounting pressure to s...The rapper has signed a contract to design an ...1475610.4450.951
16Police should face time limits on how long a p...Theresa May is demanding action amid mounting ...850510.4860.922
17Two Second World War Lancaster bombers flew to...The Lancaster Thumper joined the Canadian Lanc...902560.4910.839
18Andy Murray knows there can be no let up in hi...Andy Murray beat David Ferrer 5-7 6-2 7-5 in t...562460.5520.804
19A lifelong dream becomes reality for Chris Cor...Chris Cork is set to embark on the 5,500-mile ...703580.5450.759
\n", + "
\n", + "
\n", + "\n", + "
\n", + " \n", + "\n", + " \n", + "\n", + " \n", + "
\n", + "\n", + "\n", + "
\n", + " \n", + "\n", + "\n", + "\n", + " \n", + "
\n", + "
\n", + "
\n" + ], + "text/plain": [ + " articles \\\n", + "0 By . Chris Parsons . PUBLISHED: . 02:41 EST, 2... \n", + "1 By . Damien Gayle . PUBLISHED: . 08:10 EST, 12... \n", + "2 A father who imported a stun gun disguised as ... \n", + "3 February 10, 2015 . Economics, international p... \n", + "4 By . James Rush . PUBLISHED: . 10:51 EST, 5 Ap... \n", + "5 By . Daily Mail Reporter . PUBLISHED: . 19:11 ... \n", + "6 By . James Rush . PUBLISHED: . 06:02 EST, 30 S... \n", + "7 By . Sam Webb and Amanda Williams . PUBLISHED:... \n", + "8 (CNN) -- When CNN highlighted some excellent h... \n", + "9 (CNN) -- Japanese golf prodigy Ryo Ishikawa ha... \n", + "10 Warsaw (CNN) -- Eleven people died and one, so... \n", + "11 By . Associated Press . PUBLISHED: . 09:08 EST... \n", + "12 By . Adam Shergold . PUBLISHED: . 13:08 EST, 5... \n", + "13 Once an annual round of exclusive balls, refin... \n", + "14 (CNN) -- The memory unit that may tell why an ... \n", + "15 By . James Nye . Under mounting pressure to s... \n", + "16 Police should face time limits on how long a p... \n", + "17 Two Second World War Lancaster bombers flew to... \n", + "18 Andy Murray knows there can be no let up in hi... \n", + "19 A lifelong dream becomes reality for Chris Cor... \n", + "\n", + " bart_summaries source_word_count \\\n", + "0 Valerie Trierweiler tweeted support for a poli... 719 \n", + "1 Nasa and Florida Institute for Human and Machi... 853 \n", + "2 John Liddiatt, 40, ordered the device online w... 538 \n", + "3 This page includes the show Transcript. Use th... 239 \n", + "4 Boy, three, two teenagers and a man in his 30s... 581 \n", + "5 Grover J. Prewitt Jr., 60, of Bristow was arre... 789 \n", + "6 Sheik Mohammed bin Rashid Al Maktoum has order... 727 \n", + "7 Six out of the last seven UK summers have seen... 1351 \n", + "8 Tampa's Columbia Restaurant is 107 years old. ... 1440 \n", + "9 Japanese golf prodigy Ryo Ishikawa will donate... 235 \n", + "10 A small aircraft belonging to a private parach... 193 \n", + "11 Allegations that male instructors had sex with... 1011 \n", + "12 Matt Prior hits back at Piers Morgan's claims ... 598 \n", + "13 The Queen Charlotte's Ball was held last night... 1022 \n", + "14 NEW: Air France says the memory unit is part o... 468 \n", + "15 The rapper has signed a contract to design an ... 1475 \n", + "16 Theresa May is demanding action amid mounting ... 850 \n", + "17 The Lancaster Thumper joined the Canadian Lanc... 902 \n", + "18 Andy Murray beat David Ferrer 5-7 6-2 7-5 in t... 562 \n", + "19 Chris Cork is set to embark on the 5,500-mile ... 703 \n", + "\n", + " summary_word_count source_lexical_diversity summary_lexical_diversity \n", + "0 40 0.517 0.925 \n", + "1 56 0.523 0.857 \n", + "2 54 0.507 0.815 \n", + "3 48 0.640 0.833 \n", + "4 48 0.508 0.938 \n", + "5 48 0.485 0.917 \n", + "6 53 0.469 0.925 \n", + "7 59 0.432 0.814 \n", + "8 48 0.578 0.917 \n", + "9 49 0.651 0.878 \n", + "10 57 0.731 0.895 \n", + "11 47 0.533 0.894 \n", + "12 68 0.548 0.824 \n", + "13 48 0.430 0.875 \n", + "14 54 0.611 0.833 \n", + "15 61 0.445 0.951 \n", + "16 51 0.486 0.922 \n", + "17 56 0.491 0.839 \n", + "18 46 0.552 0.804 \n", + "19 58 0.545 0.759 " + ] + }, + "execution_count": 15, + "metadata": {}, + "output_type": "execute_result" + } + ], + "source": [ + "# Compute word count and append to bart dataframe\n", + "bart_df['source_word_count'] = bart_df['articles'].apply(lambda x: calculate_word_count(x))\n", + "\n", + "# Compute summary word count and append to bart dataframe\n", + "bart_df['summary_word_count'] = bart_df['bart_summaries'].apply(lambda x: calculate_word_count(x))\n", + "\n", + "# Compute lexical diversity and append to dataframe\n", + "bart_df['source_lexical_diversity'] = bart_df['articles'].apply(lambda x: calculate_lexical_diversity(x))\n", + "\n", + "# Compute summary. lexical diversity and append to dataframe\n", + "bart_df['summary_lexical_diversity'] = bart_df['bart_summaries'].apply(lambda x: calculate_lexical_diversity(x))\n", + "\n", + "# Display the DataFrame\n", + "bart_df" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 1000 + }, + "id": "09eJMd2CT5h5", + "outputId": "7216b3b9-3113-4393-98c9-a3dafe37eb26" + }, + "outputs": [ + { + "data": { + "text/html": [ + "\n", + "
\n", + "
\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
articlesbart_samsum_summariessource_word_countsource_lexical_diversitysummary_word_countsummary_lexical_diversity
0By . Chris Parsons . PUBLISHED: . 02:41 EST, 2...Segolene Royal lost the presidential election ...7190.517470.872
1By . Damien Gayle . PUBLISHED: . 08:10 EST, 12...Nasa and the Florida Institute for Human and M...8530.523560.857
2A father who imported a stun gun disguised as ...John Liddiatt, 40, imported a stun gun disguis...5380.507500.880
3February 10, 2015 . Economics, international p...This page includes CNN Student News stories on...2390.640540.889
4By . James Rush . PUBLISHED: . 10:51 EST, 5 Ap...A three-year-old boy and two other people rema...5810.508500.800
5By . Daily Mail Reporter . PUBLISHED: . 19:11 ...Grover J. Prewitt Jr., 60, of Bristow, Oklahom...7890.485540.889
6By . James Rush . PUBLISHED: . 06:02 EST, 30 S...Banned equine drugs were found on a Dubai gove...7270.469430.930
7By . Sam Webb and Amanda Williams . PUBLISHED:...Met Office experts predict a decade of wet sum...13510.432410.854
8(CNN) -- When CNN highlighted some excellent h...Last month, CNN highlighted some excellent his...14400.578410.902
9(CNN) -- Japanese golf prodigy Ryo Ishikawa ha...Ryo Ishikawa will donate his tournament earnin...2350.651480.875
10Warsaw (CNN) -- Eleven people died and one, so...Eleven people died and one survived when a sma...1930.731420.881
11By . Associated Press . PUBLISHED: . 09:08 EST...Col. Glenn Palmer delivered his first order to...10110.533540.889
12By . Adam Shergold . PUBLISHED: . 13:08 EST, 5...Matt Prior has hit back at Piers Morgan's clai...5980.548540.852
13Once an annual round of exclusive balls, refin...The debutante ball has lost its royal patronag...10220.430400.900
14(CNN) -- The memory unit that may tell why an ...The memory unit that may tell why an Air Franc...4680.611500.780
15By . James Nye . Under mounting pressure to s...James Nye has released a statement on his webs...14750.445570.895
16Police should face time limits on how long a p...Theresa May is demanding action against police...8500.486460.935
17Two Second World War Lancaster bombers flew to...Two World War II-era Lancaster bombers flew to...9020.491450.867
18Andy Murray knows there can be no let up in hi...Andy Murray beat David Ferrer in the final of ...5620.552470.745
19A lifelong dream becomes reality for Chris Cor...Chris Cork will start his Dakar journey in Bue...7030.545470.851
\n", + "
\n", + "
\n", + "\n", + "
\n", + " \n", + "\n", + " \n", + "\n", + " \n", + "
\n", + "\n", + "\n", + "
\n", + " \n", + "\n", + "\n", + "\n", + " \n", + "
\n", + "
\n", + "
\n" + ], + "text/plain": [ + " articles \\\n", + "0 By . Chris Parsons . PUBLISHED: . 02:41 EST, 2... \n", + "1 By . Damien Gayle . PUBLISHED: . 08:10 EST, 12... \n", + "2 A father who imported a stun gun disguised as ... \n", + "3 February 10, 2015 . Economics, international p... \n", + "4 By . James Rush . PUBLISHED: . 10:51 EST, 5 Ap... \n", + "5 By . Daily Mail Reporter . PUBLISHED: . 19:11 ... \n", + "6 By . James Rush . PUBLISHED: . 06:02 EST, 30 S... \n", + "7 By . Sam Webb and Amanda Williams . PUBLISHED:... \n", + "8 (CNN) -- When CNN highlighted some excellent h... \n", + "9 (CNN) -- Japanese golf prodigy Ryo Ishikawa ha... \n", + "10 Warsaw (CNN) -- Eleven people died and one, so... \n", + "11 By . Associated Press . PUBLISHED: . 09:08 EST... \n", + "12 By . Adam Shergold . PUBLISHED: . 13:08 EST, 5... \n", + "13 Once an annual round of exclusive balls, refin... \n", + "14 (CNN) -- The memory unit that may tell why an ... \n", + "15 By . James Nye . Under mounting pressure to s... \n", + "16 Police should face time limits on how long a p... \n", + "17 Two Second World War Lancaster bombers flew to... \n", + "18 Andy Murray knows there can be no let up in hi... \n", + "19 A lifelong dream becomes reality for Chris Cor... \n", + "\n", + " bart_samsum_summaries source_word_count \\\n", + "0 Segolene Royal lost the presidential election ... 719 \n", + "1 Nasa and the Florida Institute for Human and M... 853 \n", + "2 John Liddiatt, 40, imported a stun gun disguis... 538 \n", + "3 This page includes CNN Student News stories on... 239 \n", + "4 A three-year-old boy and two other people rema... 581 \n", + "5 Grover J. Prewitt Jr., 60, of Bristow, Oklahom... 789 \n", + "6 Banned equine drugs were found on a Dubai gove... 727 \n", + "7 Met Office experts predict a decade of wet sum... 1351 \n", + "8 Last month, CNN highlighted some excellent his... 1440 \n", + "9 Ryo Ishikawa will donate his tournament earnin... 235 \n", + "10 Eleven people died and one survived when a sma... 193 \n", + "11 Col. Glenn Palmer delivered his first order to... 1011 \n", + "12 Matt Prior has hit back at Piers Morgan's clai... 598 \n", + "13 The debutante ball has lost its royal patronag... 1022 \n", + "14 The memory unit that may tell why an Air Franc... 468 \n", + "15 James Nye has released a statement on his webs... 1475 \n", + "16 Theresa May is demanding action against police... 850 \n", + "17 Two World War II-era Lancaster bombers flew to... 902 \n", + "18 Andy Murray beat David Ferrer in the final of ... 562 \n", + "19 Chris Cork will start his Dakar journey in Bue... 703 \n", + "\n", + " source_lexical_diversity summary_word_count summary_lexical_diversity \n", + "0 0.517 47 0.872 \n", + "1 0.523 56 0.857 \n", + "2 0.507 50 0.880 \n", + "3 0.640 54 0.889 \n", + "4 0.508 50 0.800 \n", + "5 0.485 54 0.889 \n", + "6 0.469 43 0.930 \n", + "7 0.432 41 0.854 \n", + "8 0.578 41 0.902 \n", + "9 0.651 48 0.875 \n", + "10 0.731 42 0.881 \n", + "11 0.533 54 0.889 \n", + "12 0.548 54 0.852 \n", + "13 0.430 40 0.900 \n", + "14 0.611 50 0.780 \n", + "15 0.445 57 0.895 \n", + "16 0.486 46 0.935 \n", + "17 0.491 45 0.867 \n", + "18 0.552 47 0.745 \n", + "19 0.545 47 0.851 " + ] + }, + "execution_count": 16, + "metadata": {}, + "output_type": "execute_result" + } + ], + "source": [ + "# Compute word count and append to samsum dataframe\n", + "samsum_df['source_word_count'] = samsum_df['articles'].apply(lambda x: calculate_word_count(x))\n", + "\n", + "# Compute lexical diversity and append to dataframe\n", + "samsum_df['source_lexical_diversity'] = samsum_df['articles'].apply(lambda x: calculate_lexical_diversity(x))\n", + "\n", + "# Compute summary word count and append to bart dataframe\n", + "samsum_df['summary_word_count'] = samsum_df['bart_samsum_summaries'].apply(lambda x: calculate_word_count(x))\n", + "\n", + "# Compute summary. lexical diversity and append to dataframe\n", + "samsum_df['summary_lexical_diversity'] = samsum_df['bart_samsum_summaries'].apply(lambda x: calculate_lexical_diversity(x))\n", + "\n", + "# Display the DataFrame\n", + "samsum_df" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "c4gVzSU9Wkja" + }, + "source": [ + "## 2. Log Tables to W&B to compare two model approaches" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "zU3hVGV3erzn" + }, + "source": [ + "[W&B Tables](https://docs.wandb.ai/guides/tables) help you visualize and query tabular data, whether it be numeric, categorical, text, images, or multimodal datasets. Tables help users compare how different models perform on the same test set, identify patterns in data (especially helpful with text analysis), and query inputs and outputs effectively to find outliers or useful patterns.\n", + "
\n", + "
\n", + "Here we log our automatically-generated summaries to W&B as an initial step in the overall LLM development and evaluation process. If you do not have a W&B account yet, follow this simple [quickstart](https://docs.wandb.ai/quickstart) to get set up 🌟" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "Cpdn0IVBT5X_" + }, + "outputs": [], + "source": [ + "# log bart table to W&B\n", + "run = wandb.init(project=\"news_summarization\", name=\"load_bart_df\")\n", + "bart_table_v1 = wandb.Table(dataframe=bart_df)\n", + "wandb.log({\"BART summaries v1\": bart_table_v1})" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "6xBm3xsAVh4g" + }, + "outputs": [], + "source": [ + "wandb.finish()" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "WP44kTkBT5VJ" + }, + "outputs": [], + "source": [ + "# log samsum table to W&B\n", + "run = wandb.init(project=\"news_summarization\", name=\"load_samsum_df\")\n", + "samsum_table_v1 = wandb.Table(dataframe=samsum_df)\n", + "wandb.log({\"SAMSUM summaries v1\":samsum_table_v1})" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "2YlHkibaVjic" + }, + "outputs": [], + "source": [ + "wandb.finish()" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "VHsKF21jVUuk" + }, + "outputs": [], + "source": [ + "# log joint table to W&B\n", + "run = wandb.init(project=\"news_summarization\", name=\"load_joint_df\")\n", + "joint_table_v1 = wandb.Table(dataframe=joint_df)\n", + "wandb.log({\"Combined summaries v1\": joint_table_v1})" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "MD_JJS-lVUr7" + }, + "outputs": [], + "source": [ + "wandb.finish()" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "cIoZtV7-Wzlp" + }, + "source": [ + "## 3. Download CSV files of Tables to annotate in Streamlit" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "YzbmHcXqf4WR" + }, + "source": [ + "W&B Tables can be exported easily, [programatically](https://docs.wandb.ai/guides/tables/tables-download) or from the UI. To instrument with python, we will convert a table to a W&B artifact (learn more [here](https://docs.wandb.ai/guides/artifacts) and then to a dataframe. From there, it's a simple csv export.\n", + "
\n", + "
\n", + "These csv files can be loaded to a simple Streamlit app for labeling." + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "BbUR_kYtgPp1" + }, + "outputs": [], + "source": [ + "# Example of how to load a table from step 2 to a csv file\n", + "bart_WB_df = bart_table_v1.get_dataframe()" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "xYnj85vugPm6" + }, + "outputs": [], + "source": [ + "# Convert the table data to .csv\n", + "bart_WB_df.to_csv(\"example.csv\", encoding=\"utf-8\")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "j2wM0qWZWrni" + }, + "source": [ + "## 4. Annotate tables with Streamlit data editor\n", + "\n", + "This W&B repo contains a simple app that takes a user-loaded .csv file, creates a dataframe, displays that dataframe in a Streamlit app, and enables manual editing and exporting of a revised .csv file." + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "MrtDzSjEh1Ba" + }, + "source": [ + "Once you have built your app and have it stored with any dependencies needed, you can run the app wherever Streamlit is installed with `run streamlit app.py` and you will get a URL for the app (http://localhost:8501/)" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "j33w1C7UWvsI" + }, + "source": [ + "## 5. Load annotated Tables to W&B for versioning and evaluation\n", + "\n", + "Once you have revised any or all entries in your Streamlit tables and exported the new .csv files, you can load the annotated version to the same W&B project to capture that step, and all its metadata, to keep in a central system of record for your LLM development project." + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "EZhpxH0FW6VI" + }, + "outputs": [], + "source": [ + "# Create DataFrame\n", + "annotated_bart_df = pd.read_csv('annotated_bart.csv', index_col=0)\n", + "annotated_bart_df.head()" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "EBP_VT8WgDD0" + }, + "outputs": [], + "source": [ + "# Create DataFrame\n", + "annotated_samsum_df = pd.read_csv('annotated_samsum.csv', index_col=0)\n", + "annotated_samsum_df.head()" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "blPAKlLeW6Sh" + }, + "outputs": [], + "source": [ + "# Log as artifact to a project\n", + "run = wandb.init(project=\"news_summarization\")\n", + "bart_table = wandb.Table(dataframe=annotated_bart_df)\n", + "wandb.log({\"Annotated BART summaries\": bart_table})" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "Na2kNHVrW6Pq" + }, + "outputs": [], + "source": [ + "# Log as artifact to a project\n", + "run = wandb.init(project=\"news_summarization\")\n", + "samsum_table = wandb.Table(dataframe=annotated_samsum_df)\n", + "wandb.log({\"Annotated SAMSUM summaries\": samsum_table})" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "HecwlqqGjGg5" + }, + "outputs": [], + "source": [ + "wandb.finish()" + ] + } + ], + "metadata": { + "accelerator": "GPU", + "colab": { + "gpuType": "V100", + "machine_shape": "hm", + "provenance": [], + "toc_visible": true + }, + "kernelspec": { + "display_name": "Python 3", + "name": "python3" + }, + "language_info": { + "name": "python" + } + }, + "nbformat": 4, + "nbformat_minor": 0 +} diff --git a/examples/streamlit/annotation/README.md b/examples/streamlit/annotation/README.md new file mode 100644 index 00000000..0829a992 --- /dev/null +++ b/examples/streamlit/annotation/README.md @@ -0,0 +1,48 @@ +# Streamlit + W&B for LLM Annotation + +Try W&B Tables and Streamlit data editor to annotate data for LLMs. + +This repo builds a simple app for labeling and annotating tables. These tables can be sample text outputs from developing LLMs. For example, you can test a set of sample prompts, get the LLM responses, and then save those results to be annotated in this workflow. + +Here's a quick overview: +1. Set up a virtual environment and install dependencies +2. Run the Streamlit App locally, and customize the UI +3. Annotate and version tables of data using W&B + Streamlit + +## 1. Set Up Environment +Start your virtual environment, and install all dependencies from the requirements file. This simple app just uses `pandas` and `streamlit`. +```shell +pip install -r requirements.txt +``` + +## 2. Run the Streamlit App +Open the `wandb_streamlit_app.py` file, take a look at the app definition, and make edits. +Edit the column configuration, as defined [in the Streamlit docs.](https://docs.streamlit.io/library/api-reference/data/st.column_config) + +### Optional: Apply a custom theme + +Create a hidden `.streamlit` folder in the root of the project with the following command: +```shell +mkdir .streamlit +``` + +Copy the `config.toml` file to the hidden folder and edit as desired. This will apply that theme to the Streamlit app as you run it. There are multiple ways to work with custom themes but this is one of the simplest ways. +- [This video tutorial](https://www.youtube.com/watch?v=Mz12mlwzbVU) provides a nice walkthrough of creating and applying custom themes +- W&B color palette detail can be found [here](https://congenial-broccoli-daa12ae2.pages.github.io/?path=%2Fstory%2Fcommon-colors--overview) + +Finally, run the Streamlit app on localhost: +```shell +streamlit run wandb_streamlit_app.py +``` +From there, you can edit the columns that have been configured for labeling: +![Screenshot 2024-02-06 at 5 16 48 PM](https://github.com/wandb/annotation_streamlit/assets/14133187/0439eb5f-1d1a-4495-bad7-c57a94ce7563) + +## 3. Annotate and Version Tables + +This is what the data looks like from the CSV of sample LLM inputs and outputs: +sample table + +Once loaded as a W&B Table, we have a clean, annotated version of this workflow, complete with metadata, in our system of record: +![Screenshot 2024-02-06 at 5 06 25 PM](https://github.com/wandb/annotation_streamlit/assets/14133187/aa404c53-b934-47d0-a29b-c7e2cbef27a1) + + diff --git a/examples/streamlit/annotation/bart_original.csv b/examples/streamlit/annotation/bart_original.csv new file mode 100644 index 00000000..228aefae --- /dev/null +++ b/examples/streamlit/annotation/bart_original.csv @@ -0,0 +1,21 @@ +,articles,bart_summaries,source_word_count,summary_word_count,source_lexical_diversity,summary_lexical_diversity +0,"By . Chris Parsons . PUBLISHED: . 02:41 EST, 22 June 2012 . | . UPDATED: . 03:12 EST, 22 June 2012 . Segolene Royal reignited her row with the French First Lady last night when she blamed Valerie Trierweiler for her presidential election defeat to Nicolas Sarkozy. The pair had becomed embroiled in a political spat last week when it emerged that Miss Trierweiler had tweeted support for a politician standing against Miss Royal, 58, in parliamentary elections. A presidential aide said Miss Trierweiler, 47 – nicknamed the Rottweiler – had since been told to ‘stay in the shadows’ because president Francois Hollande was ‘furious’ at her intervention. Backtrack: France's controversial new first lady Valerie Trierweiler (left) now 'regrets' humiliating the mother of the President's four children Segolene Royal (right) But the row dubbed the 'the war of the . roses' erupted again last night when Miss Royal, who said she was . 'wounded' by the 'violent blow', claimed Miss Trierweiler had been . undermining her career for years since starting a relationship with her . ex-partner. Miss Segolene, the mother of President . Hollande's four children, had already accused senior Socialist . politicians of not being supportive enough in her 2007 campaign. But she went a step further in an . interview with French weekly Le Point yesteryday, claiming France's . first lady had kept Mr Hollande away from her during the campaign. She said: 'I realise that in 2007 (Mr . Hollande's affair with Trierweiler) can't have helped matters. I now . understand why François didn't help me. 'In 2007, I said to myself: 'It will pass, it'll work itself out.' So I took it on the chin.' Miss Royal is said to have told friends that Miss Trierweiler is a 'traitor' who her treated her disgracefully. Ms Trierweiler took to Twitter to announce her support for socialist Olivier Falorni . Miss Royal said it was unfair that . Miss Trierweiler had been allowed to carry on writing about Mr Hollande . in her 'Paris Match' arts column. Miss Royal told Le Point: 'In an . Anglo-Saxon country, she would have been fired the same day. But Paris . Match was not unhappy to see me weakened, so they let (the relationship) go on deliberately, just like all those others who knew ...(Paris Match . owner) Lagardère, Sarkozy.' Her outburst finished when she claimed that 'I'm the one whose family has been broken, I'm, the one who should bear a grudge.' France's first lady said last night she regretted humiliating the mother of the president’s four children. Mr Hollande, who lived with Miss Royal . for 30 years, wanted to make her the speaker of the National Assembly . but backed down when she lost the election. Telling off: Following Valerie Trierweiler's (pictured right) Twitter comments, Prime minister Jean-Marc Ayrault said 'everyone should know their place' A friend of Miss Trierweiler said she admitted: ‘I made a mistake.’ The friend added: ‘She did not calculate the consequences.’ Ms Trierweiler, who has been divorced . twice, has three sons of her own and said that the only reason she had . not travelled to Mexico with Hollande for the G8 meeting was because . they have exams this week. Intriguingly, Ms Trierweiler's . personal biography has disappeared from the Elysee Palace website, but . another aide insisted that it was 'being edited' and would return. But the same aide confirmed that Ms . Trierweiler was being encouraged to 'remain in the shadows'  because Ms . Hollande was 'furious' at the way she has behaved so far. Glamour: Hollande initially painted himself as an antidote to the flash previous President Nicolas Sarkozy, who married model Carla Bruni . Referring to the tweet, he said 'clearly this cannot happen again'. Despite the continuing saga which has . reduced the Elysee to a soap opera, journalist Ms Trierweiler's arts . column is set to appear in Paris Match magazine this week. And she has insisted she will not give up her Twitter account. Mr Hollande has now refused to give Ms Royal a job because she lost the La Rochelle seat in western France so heavily. But, despite consistent defeats since . being rejected for the presidency in 2007, Ms Royal insists that she can . revive her political career.",Valerie Trierweiler tweeted support for a politician standing against Segolene Royal in parliamentary elections. Miss Royal said she was 'wounded' by the 'violent blow' to her political career. First Lady now 'regrets' humiliating the mother of the President's four children.,719,40,0.517,0.925 +1,"By . Damien Gayle . PUBLISHED: . 08:10 EST, 12 October 2012 . | . UPDATED: . 09:36 EST, 14 October 2012 . A spinoff from robotic space technology may someday help astronauts stay fit in space and help paraplegics walk on Earth, Nasa says. The U.S. space agency and the Florida Institute for Human and Machine Cognition (IHMC) have jointly developed a robotic exoskeleton called X1. The 57lb device is a robot that a human could wear over his or her body either to assist or inhibit movement in leg joints. Scroll down for video . Dual use: The X1 exoskeleton, currently in development, could help astronauts exercise in space and paraplegics walk on Earth. It is based on the technology behind Robonaut 2, the first humanoid robot in space . In the inhibit mode, the X1 exoskeleton would be used as an in-space exercise machine to supply resistance against leg movement. The same technology could be used in reverse on the ground, potentially helping some individuals walk for the first time. The X1 is based on the technology behind Robonaut 2, the first humanoid robot in space, which is currently working with astronauts aboard the International Space Station. 'Robotics is playing a key role aboard the International Space Station and will be critical in our future human exploration of deep space,' said Michael Gazarik, director of Nasa's Space Technology Program. 'What's extraordinary about space technology and our work with projects like Robonaut are the unexpected possibilities space tech spinoffs may have right here on Earth. 'It's exciting to see a Nasa-developed technology might one day help people with serious ambulatory needs to begin to walk again, or even walk for the first time. 'That's the sort of return on investment Nasa is proud to give back to America and the world.' Nasa's Robonaut 2 aboard the International Space Station: The technology for the X1 exoskeleton was adapted from the Robonaut project . From the waist up, 27-year-old Sophie Morgan is every inch the pretty blonde girl-next-door. But from the waist down, with her legs encased in £90,000 of motorised carbon-fibre, she is RoboCop. Sophie’s thumb manipulates a joystick built into the armrests of her suit, causing the legs to hiss and whirr into life, before she takes three slow but sure steps. Her face breaks into a broad grin. Nasa's X1 prototype is not the only exoskeleton in development that could help disabled people walk again. Sophie is one of the first people in the world to benefit from a robotic exoskeleton called Rex. Once in, the only movement needed is the strength to operate a small joystick, which instructs 29 micro-controllers within the machine to react within milliseconds. The user can move in all directions, sit down, and ascend and descend stairs. It is this technology that will, arguably, mark the end of the wheelchair. But as yet there are currently just ten in existence and only 30 people have tried Rex. Rex weighs nearly 6st and is relatively bulky, yet experts predict that within the next few decades the devices will be small and light enough to slip on under a pair of jeans. Worn over the legs, with a harness . that reaches up the back and around the shoulders, X1 has four motorised . joints at the hips and the knees, and six passive joints that allow for . sidestepping, turning and pointing, and flexing a foot. There also are multiple adjustment points, allowing the X1 to be used in many different ways. Nasa is examining the potential for the X1 as an exercise device to improve crew health both aboard the space station and during future long-duration missions to an asteroid or Mars. Without taking up valuable space or weight during missions, X1 could replicate common crew exercises, which are vital to keeping astronauts healthy in zero gravity. In addition, the device has the ability to measure, record and stream back data in real-time to flight controllers on Earth, giving doctors better insight into the crew's exercise. X1 could also provide a robotic power boost to astronauts as they work on the surface of distant planetary bodies. Coupled with a spacesuit, X1 could provide additional force when needed during surface exploration. Here on Earth, IHMC is interested in developing and using X1 as an assistive walking device. It has the potential to produce high torques to allow for assisted walking over varied terrain, as well as stair climbing. 'We greatly value our collaboration with Nasa,' said Ken Ford, IHMC's director and CEO. 'The X1's high-performance capabilities will enable IHMC to continue performing cutting-edge research in mobility assistance and expand into rehabilitation.' The potential of X1 extends to other applications, including rehabilitation, gait modification and offloading large amounts of weight from the wearer. Preliminary studies by IHMC have already shown X1 to be more comfortable, easier to adjust, and easier to put on than older exoskeleton devices. Researchers now plan on improving on the X1 design by adding more active joints to areas such as the ankle and hip to increase the potential uses for the device.","Nasa and Florida Institute for Human and Machine Cognition have jointly developed a robotic exoskeleton called X1. The 57lb device is a robot that a human could wear over his or her body to assist or inhibit movement in leg joints. It is based on the technology behind Robonaut 2, the first humanoid robot in space.",853,56,0.523,0.857 +2,"A father who imported a stun gun disguised as an iPhone walked free from court yesterday. John Liddiatt, 40, ordered the device online while browsing collectible replica weapons. But when suspicious customs officers investigated the parcel from Singapore they found the replica iPhone and immediately passed it to the police. Walking free: John Liddiatt (pictured) was sentenced to 12 months imprisonment, suspended for a year . Officers confirmed the device was a weapon and it was re-wrapped before being delivered to Liddiatt at his home address. The dad-of-three was immediately arrested and confessed he had ordered the device, but claimed he had no idea it would be real because of its cheap price. Liddiatt, of Broad Walk, Knowle, Bristol, admitted one count of acquiring a disguised firearm at Bristol Crown Court and was sentenced to 12 months imprisonment, suspended for a year. The black phone, which is in a cover, came with a charger and has two prongs in the bottom which act as pins for the stun gun. Sentencing, Judge Martin Picton told him: 'It is a pretty poor imitation of an iPhone of some description in a box that is meant to look real.' The court heard how weapon collector Liddiatt ordered the stun gun on December 5 2013 from a website he usually used to purchase replica items. George Threlfall, prosecuting, said: 'On December 19 a package was sent from Singapore, addressed to Liddiatt at his home address. 'It was intercepted by customs and officers opened it and revealed what they believed to be a stun gun device. 'This was passed on to police and following examination, firearms officers who confirmed it was a stun gun with the appearance of a mobile phone.' Police then re-packaged the device before an officer, dressed as a postman, delivered it to Liddiatt's home. Unrealistic: Judge Martin Picton told Liddiatt: 'It is a pretty poor imitation of an iPhone of some description in a box that is meant to look real' Weapon: The black phone, which is in a cover, comes with a charger and has two prongs in the bottom which act as pins for the stun gun . He told officers he was an avid collector of replica crossbows, swords and masks which had appeared in movies and did not realise it was an offence to import the stun gun. Jane Chamberlin, defending Liddiatt, said: 'We have a defendant who has kept the item under the stairs and who volunteered it to police. 'It was not going to be put out in the public domain.' After the sentencing, Avon and Somerset police warned of the risks of importing illegal weapons over the internet. Investigating officer PC Chris Downham said: 'It is imperative that items bought from abroad and imported into this country are legal according to UK laws. 'Stun guns like the ones seized in this case are prohibited and dangerous weapons capable of causing considerable harm. 'It's the responsibility of the buyer to ensure they are complying with the law before ordering items over the internet. 'Liddiatt had tested the items when they arrived and was fully aware they were a viable working device.' Liddiatt was also ordered to carry out 200 hours of unpaid work.","John Liddiatt, 40, ordered the device online while browsing collectible replica weapons. But suspicious customs officers investigated the parcel from Singapore. They found the replica iPhone and immediately passed it to the police. Officers confirmed the device was a weapon and it was re-wrapped. The dad-of-three admitted one count of acquiring a disguised firearm.",538,54,0.507,0.815 +3,"February 10, 2015 . Economics, international politics, rocket science and careers are four subjects explored this Tuesday on CNN Student News. First up: U.S. cities like Boston are strapped for cash when it comes to their snow-removal budgets. Then, we examine why approval ratings are high for Russia's president despite the strains on his nation's economy. We'll explain the big goal of an upcoming rocket launch and look at the salaries of photographers and helicopter pilots. On this page you will find today's show Transcript and a place for you to request to be on the CNN Student News Roll Call. TRANSCRIPT . Click here to access the transcript of today's CNN Student News program. Please note that there may be a delay between the time when the video is available and when the transcript is published. CNN Student News is created by a team of journalists who consider the Common Core State Standards, national standards in different subject areas, and state standards when producing the show. ROLL CALL . For a chance to be mentioned on the next CNN Student News, comment on the bottom of this page with your school name, mascot, city and state. We will be selecting schools from the comments of the previous show. You must be a teacher or a student age 13 or older to request a mention on the CNN Student News Roll Call! Thank you for using CNN Student News!","This page includes the show Transcript. Use the Transcript to help students with reading comprehension and vocabulary. At the bottom of the page, please share your request to be on the CNN Student News Roll Call. For a chancanc call, click here to go to the CNNstudentnews.com page.",239,48,0.64,0.833 +4,"By . James Rush . PUBLISHED: . 10:51 EST, 5 April 2013 . | . UPDATED: . 11:17 EST, 5 April 2013 . Four people including a three-year-old boy remained critically ill this afternoon after a devastating blaze tore through a family home. Eight people, all but one from the same family, were rescued from the terraced, two-storey property in Honiton, Devon. A 17-year-old girl and an 18-year-old man were in a serious condition at the Royal Devon and Exeter Hospital while a man in his 30s was also seriously ill from inhaling smoke. The toddler also suffered serious injuries and was taken to Frenchay Hospital in Bristol. Another boy aged six was discharged from hospital. A three-year-old boy, two teenagers and a man in his 30s were seriously injured in hospital following a fire at this family home . Police have said officers were called to a house fire at a property in Honiton, East Devon, shortly before 8am, along with firefighters and the air ambulance. Neighbour Dave Joslin, a former firefighter, said he was woken up by the sound of fire engine sirens. He said: 'I looked out of my window and saw smoke billowing out of the upstairs window and thought, I hope no one's hurt. When I saw five fire engines outside, I knew it was serious.' Police and fire investigators remained at the scene today as inquiries were carried out. Chief . Superintendent Paul Davies, speaking from the scene, said: 'There is . nothing to suggest the cause of the fire is suspicious. But now there is . a multi-agency approach to determine the cause. 'Two . young adults and a young child were taken to hospital. The other five . are either at a hospital, being looked after by police or are with . friends. Emergency services were called to the house in Lee Close, Honiton, shortly before 8am . Police have said an investigation is underway, although there was nothing to suggest the cause was suspicious . 'It is understood a family member in the house raised the alarm. The house is badly damaged.' Mr Joslin said: 'From what I can see the fire was pretty extensive. The windows are completely out and it's pretty well blackened. 'There were five fire engines and five ambulances there at one stage. It was a shock looking out and seeing it this morning. Police and fire investigation officers remained at the scene to carry out their inquiries . 'You think, ""blimey I do hope nobody's hurt"" especially when I didn't hear anything.No explosions or anything like that. I just heard the fire engines going up.' South Western Ambulance Service said they were called to the incident at 7.36am. A spokesman said: 'The trust immediately dispatched a number of vehicles including one of the Devon air ambulances. Five ambulances and two officers were also promptly on scene, with the first vehicle arriving within four minutes. 'Members of the Hazardous Area Response Team (HART) were also in attendance. These highly trained paramedics have specialist equipment to deal with this type of situation. 'A number of casualties were treated at the scene for smoke inhalation. Four people, all thought to be in a life-threatening condition, have been taken to the Royal Devon and Exeter Hospital.' Neighbour Dave Joslin, a former firefighter, said he was woken up at about 7.30am to the sound of fire engine sirens . Police have said it was believed a family member raised the alarm .","Boy, three, two teenagers and a man in his 30s seriously injured. Eight people, all but one from the same family, rescued from terraced home. Police called to house fire in Honiton, East Devon, shortly before 8am. Neighbour Dave Joslin, a former firefighter, said he was woken u.",581,48,0.508,0.938 +5,"By . Daily Mail Reporter . PUBLISHED: . 19:11 EST, 3 May 2013 . | . UPDATED: . 03:52 EST, 4 May 2013 . Three human skeletons discovered in a hole dug for a septic tank in Oklahoma last month are most likely those of three females we went missing in 1992 authorities have announced. Grover J. Prewitt Jr., 60, of Bristow was arrested on Thursday after having admitted to police of having sprinkled black pepper over the grave to mask any odor, but under the direction of his mother he claims. The bodies are likely Wendy Camp, 23; her daughter Cynthia Britto, 6; and Lisa Kregear, 22, who was Camp's sister-in-law, the Oklahoma State Bureau of Investigation said. Missing: From left Wendy Camp, 23, her daughter Cynthia Britto, 6, and Lisa Kregear, 22, are pictured after vanishing on May 29 of 1992 . Clothing, a backpack and a purse were found in the 8-feet-deep hole near Jennings, matching items the women had when they disappeared on May 29 of 1992. Prewitt used to own the land where the bodies were found and was charged with being an accessory after the fact of first-degree murder. Investigators said he told them that he suspected in 1992 that the three were in the hole and said he spread pepper in the area at his mother's request. Prewitt's mother, Ida Prewitt who died in September of 2011, was in a bitter custody battle with Camp at the time of her disappearance having been married to Prewitt's nephew, according to investigators. In late March, Grover Prewitt told investigators that, around the time the three disappeared, his sister Beverly Noe asked him to hire a backhoe driver to dig a hole for a septic tank on 5 acres that their mother was buying from him. Accessory: Grover J. Prewitt Jr., 60, of Bristow, told police his mother Ida Prewitt, right, ordered him to dig the hole for a septic tank where the bodies were later found . The hole sat empty for a bit, then after the three went missing his mother asked him to have the backhoe driver fill the hole. Ida Prewitt never moved onto the property and later sold it. 'Grover never looked in the hole after the girls went missing because he was scared of what he would see,' agent Melissa Gann wrote in an affidavit filed in Creek County Court. Investigators have since accused Noe of being the last to have seen the three victims after driving them to Walmart. 'I never hurt nobody,' Noe told KFOR. 'I took ‘em to the Walmart. I’ll say that to my dying days.' Five days after his initial meeting with police, Prewitt met again with investigators and told one 'he really needed to look in that hole.' On April 16, crews found three bodies inside. In an interview with police on April 22, he recalled his mother asking him to sprinkle black pepper on the area. Scene: The remains were found on this private property in Pawnee County last month in an 8-foot hole that Grover Prewitt says his mother told him to sprinkle black pepper over to mask any odor . 'He told her he thought that was ""awful damn strange."" She said it would ""deter dog scents."" Grover did not question her on that matter and did as he was asked,' Gann wrote. 'He also remembered Ida saying one time she ""took care"" of those three people,' Gann wrote. Ida Prewitt died in September 2011, the investigators said. The OSBI wouldn't speculate on why Grover Prewitt stepped forward now. 'After 21 years, a lot changes in people's lives,' OSBI spokeswoman Jessica Brown said. Creek County officials did not have a record of any attorney for Prewitt. DNA testing is pending to determine definitely whether the bodies are those of the missing women and the girl. 'Now that it is open and out in the public, we need people to come forward,' she said. 'There are other people who know about this.' At a news conference Thursday, OSBI Director Stan Florence credited Prewitt's recent revelations – at the same time agents were moving in to arrest him. 'The passage of 21 years gave a tipster confidence to come forward and provide the information necessary to help push this case forward,' Florence said at the time. According to the investigators, Camp's son, 4-year-old Jonathan Noe, lived with Chad Noe in Shamrock. Chad Noe's mother, Beverly Noe, told investigators in 1992 that she drove the three to and from Shamrock, then dropped them off at a Wal-Mart in Chandler. Jennings is about 100 miles northeast of Oklahoma City and the grave site is about 19 miles from Shamrock and 30 miles from Chandler.","Grover J. Prewitt Jr., 60, of Bristow was arrested on Thursday after having admitted to police of having sprinkled black pepper over the grave to mask any odor. The bodies are likely Wendy Camp, 23; her daughter Cynthia Britto, 6; and Lisa Kregear, 22, who was Camp's sister-in-law.",789,48,0.485,0.917 +6,"By . James Rush . PUBLISHED: . 06:02 EST, 30 September 2013 . | . UPDATED: . 06:10 EST, 30 September 2013 . Swift action: Sheik Mohammed has ordered an investigation into the seizure . The owner of the scandal-hit Godolphin stable has ordered a new investigation after banned equine drugs were discovered on a Dubai government private jet when it was searched at Stansted airport. Officers from the UK Border Agency, along with the Veterinary Medicines Directorate, seized the unlicensed products from a Dubai Royal Air Wing flight earlier this year, it has been reported. Sheikh Mohammed bin Rashid Al Maktoum, monarch of the gulf emirate, has now ordered his junior wife Her Highness Princess Haya, president of the International Federation for Equestrian Sports, to carry out an investigation into the incident. The inquiry comes just weeks after a separate raid at Moorley Farm in Newmarket, which is owned by Godolphin’s Darley Management operation. According to The Guardian, the shipment, apparently labelled as 'horse tack', did not include anabolic steroids. It is believed the seizure did however contain products used on endurance horses. A spokesman for Princess Haya told the Guardian: 'Nobody seems to know in the organisation who is buying what or where. That’s one of the reforms that they want in place.' The spokesman said Sheik Mohammed had been unaware of the products on the flight as well as the raid at Moorley Farm. The spokesman also said Sheikh Mohammed's operation had not been spoken to by the VMD since the seizure and blamed the presence of the drugs on 'an internal reporting error'. Sheikh Mohammed's senior wife is Shaikha Hind bint Maktoum bin Juma Al Maktoum, a member of Dubai's ruling family Al Maktoum, who he married in 1979. His most famous junior wife is Princess Haya, who he married on April 10, 2004. Statement: A spokesman for Princess Haya (right) has said Sheikh Mohammed's (left) operation had not been spoken to by the VMD since the seizure . The British Horseracing Authority has . said it has been told by Defra there was no link between the seizure . and the racing industry. Adam . Brickell, the BHA's director of integrity, legal and risk, said: 'This . issue is a matter for Defra and the VMD, the agency responsible for . issues concerning the use and manufacture of veterinary medicines in . Britain. 'On account of our existing working . relationship with Defra and the VMD, as fellow regulatory authorities . with responsibilities for animals and their welfare, the BHA was . notified of the seizure of veterinary care products, some of which are . not licensed for use in the UK. 'Defra . have confirmed to the BHA that they consider there to be no link . between the seizure and the racing industry and that the products were . not intended for use on thoroughbreds.' A Border Force spokesman said the products seized at Stansted had now been destroyed. The spokesman told MailOnline: 'On May 3 Border Force officers at Stansted identified a quantity of veterinary products on a private plane that arrived at the airport. 'The products, which were unlicensed, had been listed as horse tack and were seized by officers. Illegal drug use: Former Godolphin trainer Mahmood al-Zarooni was banned for eight years after anabolic steroids were used on 22 horses in the stable . 'DEFRA (the Department for Environment, . Food and Rural Affairs) was contacted and confirmed Border Force . officers' identification of the medicines, which were subsequently . removed and destroyed. 'Border Force officers are on constant . alert to keep unlicensed, fake and illegal items from entering the . country — including veterinary products.' In April, former Godolphin trainer Mahmood al-Zarooni was banned for eight years after anabolic steroids were used on 22 horses in the stable. Earlier this month it was reported Sheikh Mohammed was embroiled in another drugs controversy after 124 unauthorised veterinary products were seized at Moorley Farm East in Newmarket. The farm, which is owned by Darley Stud, the banner company of his breeding operation, was the subject of a swoop in August by DEFRA (Department for Environment, Food and Rural Affairs) and is a base for endurance horses owned by the Sheik’s family. It is unknown whether the seizure at Stansted and the raid at Moorley Farm are connected.","Sheik Mohammed bin Rashid Al Maktoum has ordered an investigation into the seizure. Officers from the UK Border Agency and Veterinary Medicines Directorate seized the unlicensed products from a Dubai Royal Air Wing flight. The inquiry comes just weeks after a separate raid at Moorley Farm in Newmarket, which is owned by Godolphin.",727,53,0.469,0.925 +7,"By . Sam Webb and Amanda Williams . PUBLISHED: . 10:59 EST, 18 June 2013 . | . UPDATED: . 19:56 EST, 18 June 2013 . After suffering several soggy summers, it is not the news we were hoping for. Met Office experts who got together to discuss recent unusual weather patterns predicted yesterday that Britain faces a decade of wet summers. They blame natural warming in the Atlantic for pushing a current of fast-flowing air in the upper atmosphere, known as the jet stream, further south. People being rescued from the 2007 Summer floods in Tewkesbury, Gloucestershire. Britain could be subjected to wet summers for at least another decade, weather experts have today warned . Spectators make their way through the mud as they arrive for the British Grand Prix at Silverstone Circuit, last July. Six out of the last seven UK summers have seen above average rainfall . Six out of the last seven UK summers . have seen above average rainfall - with just 2010 the exception. It is . thought that long-term Atlantic currents could be playing an important . role. Weather and . climate experts from across the UK, who met at the Met . Office’s HQ in Exeter today to discuss the recent run of unusual seasons . in Europe, warned that as these operate on cycles of a decade or more, . we could experience sodden summers for 'years to come'. However, all is not lost as while these influence the odds of wet summers, it doesn’t rule out the possibility of bouts of sunshine and fine weather over the next few years  - starting with tomorrow, when Britain is expected to bask in its hottest day of the year. Temperatures will reach a high of 26C (78F) today before possibly hitting 30C (86F) tomorrow. But . high humidity means many areas could see rain and thunderstorms . tomorrow morning and evening and sunshine struggling to break through . the cloud. Experts from the Universities of Exeter, Leeds, Oxford, Reading and Imperial College London, as well as the Met Office, attended today's summit. Blue sky thinking: A jogger takes in the sight of Whitburn windmill, South Tyneside, as the weather heats up . Spray: As the hottest day of the year looms, Velvet is taken for a gallop through the sea by rider Dela Bute, 21, on Seaburn beach, Sunderland . Continental Europe basked in high temperatures, and that weather is set to sweep across the UK . They met to discuss weather patterns and . their potential causes in three recent seasons – the cold winter of . 2010/11, the wet summer of 2012, and this year’s cold spring. Professor Stephen Belcher, Head of the Met Office Hadley Centre and chair of the meeting, said: 'Ultimately what we’ve seen in each of these seasons is shifts in the position of the jet stream which impact our weather in certain ways at different times of year. 'The key question is what is causing the jet stream to shift in this way? There is some research to say some parts of the natural system load the dice to influence certain states of the jet stream, but this loading may be further amplified by climate change.' Brendan Jones, senior forecaster at MeteoGroup, the weather division of the Press Association, . said tomorrow's warm weather was being carried by warm air coming up from the . Continent, with Germany, France and the Low Countries seeing . temperatures soar past 30C (86F) in the past few days. 'It does look as if today and tomorrow are going to be very warm,' he said. 'I think today will be the hottest day of the year and tomorrow will break that again.' Temperatures should be high across England and Wales, with the South East seeing the highest temperatures, he said. Cyclists take advantage of the gorgeous weather to enjoy the daisy meadow at Souter Lighthouse near South Shields. The UK is set for a very warm and thundery plume of air from France which will set temperatures soaring across much of the country . Fields of gold: Twin four-year-old sisters, Florence (left) and Emma Hartley (centre) play with their friend Laura Stockwell (right) near Blithfield reservoir, Staffordshire . Blue skies covered the north east coast of England this morning. Brothers Jack (left), two, and four-year-old Oliver Hood from Durham enjoy the sunshine at Souter Lighthouse near South Shields . Because of the large amount of cloud, they are likely to hit a high of around 28C (82F) tomorrow, but any areas lucky enough to have sunshine all day may see temperatures hitting 29C (84F) or 30C (86F). Further north, temperatures will remain lower, and they will fall back to the low 20Cs from Thursday, Mr Jones said. The welcome warm blast follows what the Met Office said was the coldest spring since 1962, with a mean temperature across March, April and May of 6C (43F), 1.7C below the long-term average. Summer fun: Sharon Jamesieson (left), 20-month-old Nadia (centre) and Nadia Jamesieson, aged 16, from North Tyneside enjoy the sun on Tynemouth Beach . The sunrise over the Sean Henry sculpture 'Couple' and St Bartholomew's Church in Newbiggin-by-the-Sea, Northumberland, earlier today . Weather and climate experts from across the UK went to the Met Office’s HQ in Exeter today for a workshop to discuss the recent run of unusual seasons in Europe. A total of 25 delegates attended including representatives from the Universities of Exeter, Leeds, Oxford, Reading and Imperial College London, as well as the Met Office. Workshops of this kind are held on a regular basis on a great deal of issues across weather and climate science. Today’s included sessions which looked at the strange weather patterns and their potential causes in three recent seasons – the cold winter of 2010/11, the wet summer of 2012, and this year’s cold spring. Professor Stephen Belcher, head of the Met Office Hadley Centre and chair of the meeting, said: 'Ultimately what we’ve seen in each of these seasons is shifts in the position of the jet stream which impact our weather in certain ways at different times of year. 'The key question is what is causing the jet stream to shift in this way? 'There is some research to say some parts of the natural system load the dice to influence certain the jet stream, but this loading may be further amplified by climate change.' There are a number of possible factors which could be ‘loading the dice’, including declining Arctic sea ice, solar variability and long-term ocean cycles. The workshop focused on the latest research looking at how these drivers can influence weather patterns and discussed future research can be targeted to push forward understanding in this area. There are a wide range of factors that could be causing the cold winters such as changes in the Arctic climate. Dr James Screen, from the University of Exeter, said: 'There has been a lot of talk about declining Arctic sea ice playing a role in our weather patterns, but really that’s just one aspect of changes in the Arctic climate – which has seen rapid warming compared to other parts of the world. 'Those changes mean there is less of a difference in temperature between the Arctic and tropics, which could impact the position of the jet stream.' Another driver of colder winter weather has already been identified and is known as Sudden Stratospheric Warmings (SSWs). Recent research in this area has meant the Met Office was able to give good advice up to a month ahead on cold spells in recent seasons when they have been driven by this phenomenon. Professor Belcher said: 'This workshop has looked at some really cutting edge research and helped us identify key areas for future work to improve our understanding of potential drivers of some of the unusual seasons we have seen. 'This work will help us continue our work to push forward understanding in this area so we can give better forecasts and advice on longer timescales in the future.'Source: Met Office .","Six out of the last seven UK summers have seen above average rainfall. It is thought that long-term Atlantic currents could be to blame. Britain could be subjected to wet summers for at least another decade, weather experts have today warned. They blame natural warming in the Atlantic for pushing a current of fast-flowing air in the upper atmosphere.",1351,59,0.432,0.814 +8,"(CNN) -- When CNN highlighted some excellent historic restaurants in major cities across the country last month, readers wondered why their small-town and smaller-city favorites didn't make the cut. Thus, in this follow-up tribute to more laudable veteran restaurants, we've zeroed in -- thanks to suggestions from our commenters -- on the decades-old, and in certain cases centuries-old, icons that thrive outside of America's biggest metropolises. Columbia Restaurant, 1905 . The Hernandez/Gonzmart family claims the title of Florida's oldest restaurant and America's oldest Spanish restaurant with their 107-year-old icon Columbia in the Ybor City area of Tampa. What started as a corner cafe for the cigar workers in town has ballooned into a 1,700-seat restaurant specializing in Cuban and Spanish cuisine. Live jazz and flamenco shows are offered on most nights, and the gift shop comes complete with cigar rolling demonstrations in the afternoon. The restaurant expanded with locations across Florida -- including one in Tampa International Airport -- but the locals still stop in here for the famous Cuban sandwiches, the 1905 salad, tossed tableside and the old-school Spanish decor. 2117 East 7th Avenue, Tampa, Florida (813) 248-4961 . Louis' Lunch, 1895 . The supposed originator of the hamburger, Louis' Lunch in New Haven, Connecticut, has been serving beef patties on white toast since before buns were even invented. Legend has it that in 1900, a customer asked the restaurant's founder, Louis Lassen, for a quick meal he could eat on the run. He broiled some steak trimmings, put them between two slices of bread, and voila, the burger was born. Over a hundred years later the lunch wagon has evolved into a squat, Victorian-looking restaurant, featuring wooden chairs and carved graffiti-ridden tables and a menu offering just four items: burgers, potato chips, potato salad and pie. The patties are placed on vertical, antique 1898 cast iron grills that cook the burgers on both sides simultaneously to medium rare. And don't ask for ketchup. Only three condiments are offered: cheese spread, tomatoes and onions. 261-263 Crown Street, New Haven, Connecticut (203) 562-5507 . Samoa Cookhouse, 1893 . Back in the heyday of logging in the late 19th and early 20th centuries, companies set up cookhouses to feed their workers. These mess halls/community centers offered three hot meals a day (and cold meals on Sundays) for an affordable price, served family style. The Louisiana-Pacific Samoa Cookhouse in Samoa, California, began as one such kitchen in 1893 and continues the tradition of serving affordable, family-style meals in a no-frills setting. Current menu items include French toast, pancakes and sausage for breakfast, chicken parm and pot roast for lunch, and roast beef, short ribs and ham for dinner. Those with a strong sense of nostalgia should check out the restaurant's museum on the second level, which is filled with old photographs along with logging and maritime relics. 908 Vance Avenue, Samoa, California (707) 442-1659 . Smackdown: Tampa Bay area boasts sandy shores, surrealism . Brookville Hotel, 1870 . When the Brookville Hotel, the home of famous, affordable and hearty fried chicken dinners, was forced to move locations in 2000 due to a sewage issue, the owners decided to make an exact replica of their former home, one their loyal regulars would recognize. The new version, located 40 miles away from Brookville in Abilene, Kansas, includes a rebuilt facade and as many of the old doors and fixtures from the original hotel restaurant, with origins dating back to 1870, as possible. Brookville Hotel stopped welcoming overnight guests decades ago, but the name lives on. The chicken dinner, served since the current owners' great-grandmother originated it in 1915, includes coleslaw, half a fried chicken, mashed potatoes, creamed corn, biscuits and ice cream, all for $15. 105 E. Lafayette, Abilene, Kansas (785) 263-2244 . Shady Glen, 1948 . Manchester, Connecticut, institution Shady Glen began back in 1948 as a classic soda fountain and ice cream maker, the offshoot of a dairy farm. When the original owners, John and Bernice Rieg, decided to branch out to lure business in the colder months, they added savory diner staples to their menu -- including a special take on the classic griddle-top cheeseburger featuring a giant crown (using four slices) of crispy cheese. Burgers and homemade ice cream are still served in the old diner today, which was enlarged and renovated over the decades but has kept the same look since 1978. 840 Middle Turnpike E, Manchester, Connecticut (860) 649-4245 . Cold Springs Tavern, 1886 . Cold Springs Tavern, founded in 1886 on a site established as a stagecoach stop in the 1860s, is located 20 minutes north of Santa Barbara, California, nestled on a mountainside off a winding road. Its buildings, a group of low log cabins outfitted with fireplaces, taxidermy and animal hides, have been preserved through the decades, making this a local destination, even without much signage or promotion. The place is big with bikers, especially on Sundays when live music is offered and the Log Cabin Bar offers their locally famous tri-tip steak sandwiches. 5995 Stagecoach Rd., Santa Barbara, California (805) 967-0066 . Race for the next presidential birthplace . Red Fox Inn and Tavern, 1728 . Those looking for an old Colonial experience should seek out the Red Fox Inn and Tavern, right in the middle of Northern Virginia's hunt country. Founded in 1728, the inn housed presidents and Revolutionary War heroes, was a medical center for the Confederate Army during the Civil War, and has attracted famed guests like Jackie Onassis and Elizabeth Taylor. The tavern looks as it might have in the 18th century, with thick stone walls, large fireplaces, beamed low ceilings and long oak tables. The menu changes seasonally but features old Southern classics like fried chicken, crab cakes and peanut soup. 2 East Washington Street, Middleburg, Virginia (540) 687-6301 . Al's Restaurant, 1925 . A guide to old-school American restaurants wouldn't be complete without a grand steakhouse, and Al's Restaurant, a St. Louis fixture since 1925, fits the bill. Stepping inside the restaurant, located in an unassuming building by the city's waterfront, is like entering a time warp. Though Al's began as an outpost selling egg sandwiches to the dock workers nearby, the founders' son transformed it into a fine-dining chop house with white tablecloths, wood paneled walls and a verbal menu -- servers come around with raw cuts of meat and fish to choose from -- of chops, steaks and seafood. It's not cheap by any stretch, but Al's is a staple in the area and is run by the grandchildren and great-grandchildren of the original immigrant founders. 1200 North 1st St., St. Louis, Missouri (314) 421-6399 . Chef Vola's, 1921 . Up until the 1980s, when the current owners bought it, Chef Vola's had no phone number, no signage and survived for 60 years in the basement of an Atlantic City row house strictly by word of mouth. Though it's a little easier to access now, reservations are still tough to come by, with good reason. The setting is unique in that it feels like someone's home -- until recently diners had to walk through the dishwashing area to get to the bathroom -- and the vibe is that of a large family gathering. And then there's the food: fettuccine in clam sauce, a primal-sized veal parmigiana on the bone, steak charred ""Pittsburgh style,"" famed banana cream and caramel ricotta pies, and dozens of others delectables. Try calling the day of to see if there are any cancellations, and note it's BYOB and cash only. 111 S. Albion Pl., Atlantic City, New Jersey (609) 345-2022 . Oktoberfest closer to home: Five U.S. festivals . The Bright Star, 1907 . A large contingent of customers have been coming to The Bright Star, a 105-year-old casual Greek/Southern restaurant in downtown Bessemer, Alabama, for decades. A large contingent of the restaurant's workers have been there even longer. And its owners, Nicky and Jimmy Koikos, one of whom is there almost every shift, have been keeping the family tradition alive since 1966. Why all the dedication? First there's the fresh seafood, trucked in from the Gulf Coast daily and served with a Greek flair. But also, it serves as a community gathering place and hub for Bessemer locals, growing from a 25-seat cafe to a 330-seat restaurant over the decades. Specialties include the seafood gumbo, the Greek snapper and the lemon ice box pie. 304 19th St. North, Bessemer, Alabama (205) 424-9444 . Where have you had a favorite meal that stands out and brings back fond memories? (It doesn't have to be fancy. ) Please share in the comments below.","Tampa's Columbia Restaurant is 107 years old. Live jazz and flamenco shows are offered on most nights. The gift shop comes complete with cigar rolling demonstrations in the afternoon. The restaurant expanded with locations across Florida -- including one in New York City, where it is still open.",1440,48,0.578,0.917 +9,"(CNN) -- Japanese golf prodigy Ryo Ishikawa has announced he will donate his tournament earnings from 2011 to the victims of the tsunami which recently devastated the Asian country. Ishikawa, 19, will also give $1,200 for every birdie he achieves during the year and the world number 45 is planning a tour of the severely effected Tohuku area of Honshu Island. ""I feel thrilled. My goal is 200 million yen [$2.4 million],"" Ishikawa is reported as saying by news agency AFP. The Saitama-born star turned professional in 2008 and has earned in excess of $1.2 million during each of his three years in the sport, according to AFP. Ishikawa broke a world record in May 2010 when he shot the lowest-ever score in a major golf tournament with a 12-under par 58. ""I have enough money to spend for my golf. I still have savings. I believe this is the most positive way for me to spend money,"" he added. The nine-time winner in Japan finished third on the country's money list in 2010 and sought the advice of his father, who is a banker, before making the decision. Ishikawa is currently in the U.S. preparing for The Masters at Augusta in Georgia, which is due to start on April 7. The earthquake and tsunami which ravaged Japan is estimated to have claimed 18,000 lives and prompted a nuclear crisis at the stricken Fukushima plant.","Japanese golf prodigy Ryo Ishikawa will donate his tournament earnings from 2011 to the victims of the tsunami. Ishikawa, 19, will also give $1,200 for every birdie he achieves during the year. The world number 45 is planning a tour of the severely effected Tohuku area of Honshu Island.",235,49,0.651,0.878 +10,"Warsaw (CNN) -- Eleven people died and one, somehow, survived when a small aircraft belonging to a private parachute school crashed Saturday in Poland, state news reported. Firefighters learned about the crash near Czestochowa, a city some 140 kilometers (85 miles) north of Krakow, around 4:20 p.m., Polish Press Agency (PAP) reported. Czestochowa fire Capt. Pawel Liszaj told PAP that arriving firefighters found three people outside the aircraft, one of whom was still alive. ""Unfortunately, everything indicates that he is the only person who survived the crash,"" provincial police spokeswoman Joanna Lazar told CNN affiliate TVN. Authorities later discovered nine bodies inside the plane's wreckage, according to Liszaj. The survivor -- who was one of the three initially spotted outside the aircraft -- was flown by helicopter to a Czestochowa hospital, Robert Galazkowski, the head of the Polish Medical Air Rescue, told PAP. The 40-year-old man was conscious from the time he was found, though he suffered many injuries, including to his pelvis, according to the report. He was in serious but stable condition Saturday evening, Galazkowski said. The cause of the crash wasn't immediately known. CNN's Greg Botelho contributed to this report.","A small aircraft belonging to a private parachute school crashes near Czestochowa, state news reports. Firefighters found three people outside the aircraft, one of whom was still alive. Authorities later discovered nine bodies inside the plane's wreckage, a fire captain says. The 40-year-old man was conscious from the time he was found, though he suffered many injurings.",193,57,0.731,0.895 +11,"By . Associated Press . PUBLISHED: . 09:08 EST, 26 June 2012 . | . UPDATED: . 12:17 EST, 26 June 2012 . From a chapel pulpit on Lackland Air Force Base, where every American airman reports for basic training, Col. Glenn Palmer delivered his first order to nearly 600 recruits seated in the pews: If you're sexually harassed or assaulted, tell someone. 'My job is to give you a safe, effective training environment,' Palmer said firmly. What the colonel did not mention directly in his recent address was a widening sex scandal that has rocked the base, one of the nation's busiest military training centers. Victims?: Female airmen march during graduation at Lackland Air Force Base in San Antonio . Allegations that male instructors had sex with, and in one case raped, female trainees have led to criminal charges against four men. Charges against others are possible. The most serious accusations surround an Air Force staff sergeant scheduled to face a court-martial in July on charges that include rape and multiple counts of aggravated sexual assault. The other three defendants were charged with lesser crimes ranging from sexual misconduct to adultery. All of the defendants were assigned to turn raw recruits into airmen in eight weeks of basic training. A two-star general is now investigating alongside a separate criminal probe, which military prosecutors say could sweep up more airmen. Advocates for female service members and members of Congress have started taking notice. 'It's a pretty big scandal the Air Force is having to deal with at this point,' said Greg Jacob, a former Marine infantry officer and policy director of the Service Women's Action Network. 'It's pretty substantial in its scope.' Col. Glenn Palmer (pictured) advised recruits: If you're sexually harassed or assaulted, tell someone but did not mention the scandal . Yet there are signs the Air Force still doesn't have a handle on the full depth of the problem. Staff Sgt. Peter Vega-Maldonado pleaded guilty earlier this month to having sex with a female trainee and struck a plea deal for 90 days' confinement. Then he acknowledged being involved with a total of 10 trainees — a number previously unknown to investigators. On Friday, after months of embarrassing disclosures, the head of the Air Force's training command ordered Maj. Gen. Margaret H. Woodward to lead an independent investigation. That same day, the Air Force gave reporters rare access to Lackland's instructional headquarters in an effort to show there was nothing to hide. The headquarters facility is where Lackland trains the people who train recruits. Inside one small classroom, three women and two men were lectured on the importance of having a moral compass while watching a slide presentation titled 'Integrity First'. Lackland has about 475 instructors for the nearly 36,000 airmen who will graduate this year. That's about 85 per cent of what Lackland would consider a full roster of instructors, a demanding job that requires airmen to work longer hours than most for four years, at the expense of family and personal time. The Air Force recently launched a smartphone app to help recruit instructors. Topping a page of frequently asked questions is whether the divorce rate for instructors really is higher. (The Air Force says no.) Palmer said that a slight shortage in instructors has not lowered the standards for applicants. In response to the allegations, he said instructor training is being revamped and that he was accountable for problems within the training wing. Leaders of the instructor program, however, said the responsibility falls on the accused. 'A person sitting in that seat, they're going to do what they're going to do when no one is watching,' said Master Sgt. Greg Pendleton, who oversees the training. 'That's across the board. That's just them. When we're outside this door or outside these walls, there are individuals that have their own personal values.' Military personnel stand outside the Lackland Air Force Base in Texas, one of the nation's busiest military training centers, where four male instructors are charged with having sex with, and in one case raping, female trainees . So widespread is the fallout that Lackland halted operations for an entire day in March to survey about 5,900 trainees about whether they had seen or been a victim of sexual misconduct. It was a highly unusual move for a vast 15-square-mile base that runs with relentless efficiency. A new class of airmen graduates every Friday for 50 of the 52 weeks in the year. At first, Palmer, commander of the 737th training wing, said he wasn't sure that halting training was even possible. Airman Andrea Madison, a new graduate who was in basic training at the height of the investigation at Lackland, said she never felt uncomfortable with her instructors. 'They want to make sure no foul play is happening, no one is taking advantage of us,' said Madison, of Columbus, Ohio. Last week, one commander of a Lackland training squadron caught up in the sex scandal was dismissed after the Air Force lost confidence in his leadership. Col. Polly Kenny, 2nd Air Force Staff, said the dismissal was not directly related to the sexual misconduct investigation. The Service Women's Action Network supports and works with servicewomen . Nearly three dozen instructors at Lackland have also been removed in the past year, but the Air Force will not say how many lost their jobs as a result of the investigation that began last fall, only that the majority of dismissals were unrelated. The first sexual misconduct allegations at Lackland surfaced a year ago against Staff Sgt. Luis Walker, who is charged with 28 counts. Walker, the only instructor who has been accused of sexually assaulting another airman, faces life in prison if convicted. His civilian attorney, Joseph Esparza, has declined to speak with reporters and did not return multiple calls for comment. Sexual assault victims are reassigned and can apply for a 'humanitarian discharge' from the military, but Lackland civilian spokeswoman Collen McGhee said she did not know whether those affected by this case had done so.","Allegations that male instructors had sex with, and in one case raped, female trainees have led to criminal charges against four men. The most serious accusations surround an Air Force staff sergeant scheduled to face a court-martial in July on charges that include rape and multiple coups.",1011,47,0.533,0.894 +12,"By . Adam Shergold . PUBLISHED: . 13:08 EST, 5 February 2014 . | . UPDATED: . 13:32 EST, 5 February 2014 . England wicketkeeper Matt Prior has hit back at claims by TV personality Piers Morgan that he launched a dressing room tirade at Andy Flower during the team's disastrous tour of Australia. Morgan claimed on Twitter that Prior, who was dropped after the third Test in Perth, told the England team after the fourth Test in Melbourne that coach Flower was 'behaving like a headmaster' and they were playing in a 'schoolboy environment.' The storm comes 24 hours after England selectors sacked batsman Kevin Pietersen in the wake of England’s 5-0 Ashes defeat Down Under. VIDEO: Scroll down to see Piers Morgan trying to get out of the way a Brett Lee over . Hitting out: Matt Prior has blasted accusations from Kevin Pietersen's friend Piers Morgan . Tough time: Prior struggled in Australia and was dropped after the third Test . Morgan tweeted on Wednesday afternoon: . 'I'm about to tweet what @MattPrior13 told England players in team . meeting after Melbourne Test. ''Flower's . behaving like a headmaster, this is a schoolboy environment. F**k . Flower! This is OUR team!' - @MattPrior13 to England team.' Morgan went on to claim Prior was a 'hypocrite' and challenged him to take legal action if his accusations were incorrect. He . added: 'You stabbed @KP24 [Pietersen] in the back @MattPrior13 - yet . you agreed with him re Flower's dictator style. Makes you a flaming . hypocrite.' 'For the record, @MattPrior13 led the England team meeting after Melbourne Test. And slaughtered Flower. Happier times: Pietersen (left) and Prior celebrate Ashes victory Down Under in 2010 . 'If you didn't say it @MattPrior13 - then sue me. That should clear things up.' But Prior took to Twitter shortly afterwards to defend himself against Morgan's claims. He . wrote: 'I don't do this PR, spinning media rubbish but I refuse to be . attacked by a bloke that knows very little about what goes on in the . England setup apart from rumour, gossip and hearsay from certain . individuals (most of whom I'd take with a pinch of salt). 'Maybe . I was recorded or 'hacked' but if not I'd like to see where these words . I apparently said have come from? I'm not the kind of person to divelge . [sic] what is said in team meetings but all I will say is that Flower, . [Alastair] Cook and the rest of my team mates know exactly what I said . & the way in which it was meant! Re-integrated: Prior posted this picture of Pietersen on Twitter in late 2012 with the caption: '""Re-integration complete. Well played"".' 'There . is no story here just an attempt to knock someone who has only ever had . the teams best interests at heart and tried my best on and off the . field to help the England cricket team. 'I can hold my head up high in that knowledge! #endof' He . then retweeted a message that pointed out Prior was one of the England . team who defended Pietersen during the 'text-gate' scandal, in which the . batsman sent text messages to members of the opposition . dressing room during South Africa's tour of England in 2012. However, in response, Morgan tweeted that Prior 'was actually one of the worst re KP' and Prior 'stabbed KP right in the back.' Taking a battering: Piers Morgan (right) faces Brett Lee in the nets at the MCG .",Matt Prior hits back at Piers Morgan's claims that he launched a dressing room tirade at Andy Flower during the team's disastrous tour of Australia. Morgan claimed on Twitter that Prior told the England team after the fourth Test in Melbourne that Flower was 'behaving like a headmaster' and they were playing in a 'schoolboy environment' The storm comes 24 hours after England selectors sacked batsman Kevin Pietersen.,598,68,0.548,0.824 +13,"Once an annual round of exclusive balls, refined dinner parties and other polished social events, the London season – the highlight of which was the debutante ball- was an important way for the elite to match make the younger generations. Today however, not only has the ball has lost its royal patronage, but is barely recognisable from its aristocratic origins. Held this year in Highclere Castle, which plays host to popular ITV drama Downton Abbey, the ball is increasingly popular among affluent foreigners and mega-rich Britons looking to experience a piece of Britain's cultured past while simultaneously putting their wealth on display. Scroll down for video . Debutantes pose for a photograph before the start of the Queen Charlotte's Ball which was held last night at Highclere Castle . The young ladies rehearse their curtsy prior to the ball which marks the end of a year of charity fund raising and etiquette classes for the debutantes . This year the excited debutantes also had the opportunity to play at being the Lady Grantham as they spent hours preening in the now famous Downton castle . Each ticket to the ball cost thousands, with a table costing £2,500, meaning nearly all of the debutantes hail from ultra-rich families . Most young ladies take the opportunity to have a bespoke designer dress made for the night . In the past, young women from the very best landed gentry stock would be presented to the monarch at Buckingham Palace in a virginal white gown at the Queen Charlotte's Debutante Ball to announce their ‘coming out’ into society. No longer an event for an elite group of the British aristocracy, the Queen Charlotte's Debutante Ball, this year held at Highclere Castle, near Newbury, is now open essentially to anyone who can afford it. This year the excited debutantes also had the opportunity to play at being the Lady Grantham as they spent hours preening in the now famous castle before their sweeping entrance into the ball. The historical ball is steeped in traditions, but many claim is barely recognisable from its aristocratic origins . Each debutante will have been selected – and paid thousands of pounds- for the privilege of taking months of etiquette classes and dabbling in carefully chosen charity projects . The ladies being ‘presented’ are still a rather spectacular vision in a sea of cream silks, chiffon and lace . Debutantes prepare to take their places for a meal during the Queen Charlotte's Ball at Highclere Castle . With tables starting at £2,500 and run by a partnership of corporate sponsors and companies based in the United Arab Emirates, attendance is strictly for the well-to-do, with many traditionalists bemoaning the loss of the balls gentile and refined roots. And while the young ladies being ‘presented’ are still a rather spectacular vision in a sea of cream silks and lace, their place at the Ball will have been purchased, rather than a birth right. Apparently celebrating their year of charity fund raising, etiquette classes and ‘debut’ on the dating scene at The Queen Charlotte's Ball, most young ladies take the opportunity to have a bespoke designer dress made for the night. Each will have been selected – and paid thousands of pounds- for the privilege of taking months of etiquette classes and dabbling in carefully chosen charity projects. Debutante Elizabeth Muncey applies lipstick in her dressing room before the start of the ball . During the ball the debutantes are presented to guests and curtsy to the Queen Charlotte Cake (pictured) After the ceremony the ladies are allowed to change into a dress of their choosing for the after party- with most years leading to tales of debauchery . The young ladies, usually aged between 17 and 20 then finish their debutante experience by attending the grand ball where they are presented to guests and curtsey to the Queen Charlotte Cake. Prior to the event older debutantes are on hand to guide and critique the girls on their dress, dancing and pace around the ballroom and on the day an army of professional hair and make-up artists are on hand to make sure that the girls are glowing, setting off perfectly coiffed up 'dos with diamond studded tiaras and precious jewellery. The 'deb of the year' is chosen according to 'who has worked hardest’ during fund-raising activities throughout the season and shown the most enthusiasm. On the day an army of professional hair and make-up artists are on hand to make sure that the girls are glowing, . The young ladies, usually aged between 17 and 20, try on their couture gowns before the start of the ball . The grand ball room at Highclere castle was the venue for the after dinner dancing at this years ball . The Queen’s sister, Princess Margaret famously said of the end of the royal patronage of the ball: ‘we had to put a stop to it . . . every tart in London was getting in!’ After the ceremony the ladies are allowed to change into a dress of their choosing for the after party- with most years leading to tales of debauchery and behaviour most unfitting for a lady. The ball has been running almost every year since 1780, when King George III first organised the Queen Charlotte’s Ball as a way to celebrate his wife’s birthday. The ceremony remained unchanged- with debutantes paying respects to a large iced cake at Buckingham Palace, overseen by the monarch- until 1958, when Prince Philip persuaded the Queen to stop receiving each year’s crop at Court. Philip is said to have complained that the annual Ball, at which girls aged 17 and 18 were expected to meet their suitably-moneyed future husbands, was ‘bloody daft’. The Queen’s sister, Princess Margaret, was even more forthright, saying later ‘we had to put a stop to it . . . every tart in London was getting in!’ Since 1958 the ball was held sporadically at various exclusive venues in the capital to varying degrees of success before being relaunched in 2009 and held annually since, albeit without its royal seal of approval.",The Queen Charlotte's Ball was held last night at Highclere Castle. It marks the end of a year of charity fund raising and etiquette classes for the debutantes. The ball is increasingly popular among affluent foreigners and mega-rich Britons looking to experience a piece of Britain's cultured past.,1022,48,0.43,0.875 +14,"(CNN) -- The memory unit that may tell why an Air France jet plunged into the Atlantic nearly two years ago was recovered from the bottom of the ocean Sunday, France's Bureau of Investigation and Analysis (BEA) said. A remote-controlled submarine, known as the Remora 6000, located the memory unit Sunday morning and it was lifted on board the search ship Ile de Sein six hours later, the Paris-based BEA said. All 228 people aboard the Air France Flight 447 were killed when the plane fell into the ocean on the way from Rio de Janeiro to Paris on June 1, 2009. The submarine found the orange-colored flight data recorder's chassis Wednesday, the second day of an operation that also hopes to retrieve bodies from the wreckage site. The memory unit was part of the recorder, but was not attached when it was found. The flight recorder chassis is found last week . The finds come more than three weeks after search teams found the tail section of the Airbus A330. Air France, in a written statement Sunday, called the discovery ""very significant."" ""We hope that the BEA, in charge of the technical investigation, will be able to provide answers to questions that relatives of the victims, Air France and the entire airline industry have been asking for nearly two years as to why this tragic accident occurred,"" the airline's statement said. A British aviation consultant said he is skeptical about how useful the memory unit will be to investigators, considering it has been sitting between 2,000 to 4,000 meters (6,562 to 13,124 feet) below the ocean's surface for 23 months. ""If you were to throw a computer into the ocean, imagine how all the parts would eventually split and you have the corrosive effects of seawater and the depths involved,"" Phil Seymour, chief operating officer of the International Bureau of Aviation, said Thursday. Father of crash victim: Leave remains . ""It may be that the more wreckage they find will help them to piece it all together, which bit by bit could help them build a picture of what caused the plane to come down,"" Seymour said. Martine Del Bono, a spokeswoman for the Paris-based BEA, says there is a good chance the memory unit, which records any instructions sent to the aircraft's electronic systems, will still hold retrievable data. The Airbus A330's pilots lost contact with air traffic controllers while flying across an area of the Atlantic Ocean known for constant bands of severe turbulence, officials said. Q&A: Will mystery ever be solved? But exactly what caused the plane to plunge into the sea has remained a mystery, with only small portions of the wreckage and a handful of bodies found in the remote area where it went down. CNN's Ayesha Durgahee contributed to this report.",NEW: Air France says the memory unit is part of the flight data recorder. All 228 people aboard the Air France Flight 447 were killed when the plane fell into the ocean. A remote-controlled submarine located the unit Sunday morning. It was lifted on board the search ship Ile de Sein six hours later.,468,54,0.611,0.833 +15,"By . James Nye . Under mounting pressure to speak out about the controversy that has engulfed the department store this week, the rap mogul released a lengthy statement on his website after an online petition called for him to bow out of his upcoming partnership with Barneys. The Manhattan superstore stands accused of profiling two young black people, calling the police on both after they purchased expensive items. The rapper has signed a contract to design an exclusive line for Barneys that will be available next month. But Jay-Z - whose real name is Shawn Carter - defended himself, saying that he hasn't spoken about it because he's still trying to figure out exactly what happened. 'I move and speak based on facts and not emotion,' the statement said. Scroll Down for Video . Speaking out: Jay-Z has faced claims of supporting Barneys in the wake of their racial profiling scandal. The rapper says he is waiting to receive all the proper information before commenting or taking action, and that he has been demonized for doing so . Defending himself: Jay-Z reacts to increasing pressure in a statement on his website . 'I haven't made any comments because I am waiting on facts and the outcome of a meeting between community leaders and Barneys. 'Why am I being demonized, denounced and thrown on the cover of a newspaper for not speaking immediately?' 'I am not making a dime from this collection ... I need to make that fact crystal clear. The Shawn Carter Foundation is the beneficiary ... This money is going to help individuals facing socio-economic hardships to help further their education at institutions of higher learning. 'I am against discrimination of any kind, but if I make snap judgements, no matter who it’s towards, aren’t I committing the same sin as someone who profiles? 'I am no stranger to being profiled and I truly empathize with anyone that has been put in that position.' The statement came after residents of Marcy House, in Brooklyn, where Jay-Z grew up, called on the '99 Problems' rapper and husband of Beyonce to think about those who have not become as succesful as him.'Jay Z and my son grew up together,' said Effie Hardy, 74, to the New York Daily News. 'That could be his family Barneys is profiling. They would’ve done the same thing to him back in the day, before he got to where he is now. He should remember that.' The luxury and exclusive collection that Jay-Z has lent his considerable clout to is named 'A New York Holiday,' and the cheapest item is a $70 cotton T-shirt, while a Shawn Carter watch by Hublot with alligator skin straps will cost $33,900. Expensive: Items available from Jay-Z's new exclusive line at Barneys called 'A New York Holiday' - which has products available for tens of thousands of dollars . Another Marcy resident, Annette Rush, 40, told the New York Daily News that as a role model, Jay-Z should think about the ramifications of the two shoppers allegations. 'My money is as good as anybody else’s money. It’s all green,' said Rush. 'From someone that came from the hood, he should know all that. He knows how hard it is. I don’t think he should sell his things there, not at a place where there’s racial profiling going on. It’s ridiculous.' The controversy began when two black customers came forward to say that they had been stopped and detained after buying expensive items from the luxury store. Anger: Social media vented its dismay towards Jay-Z and one user attempted to link the Trayvon Martin case and the profiling of two customers at Barneys . Evocative: This Twitter user tries to invoke Jay-Z's paternal instincts by questioning how he would feel if his daughter was racially profiled as it is alleged the NYPD and Barneys profiled two black customers . On Tuesday, Trayon Christian, 19, from Queens said that he was suing the city and Barneys after he was accosted by two undercover NYPD detectives after he had bought a $349 Ferragamo belt. And then on Wednesday, Kayla Phillips, 21, a seven-month pregnant mother from Canarsie, Brooklyn, said that she too had been stopped. The young mother, from Brooklyn, New York, said she experienced similarly shocking treatment from staff at the Madison Avenue store in February when she bought a $2,500 Céline handbag. She has now filed a $5 million notice of claim with the city showing her intention to sue the NYPD. 'As I was walking into the train station, four undercover police officers attacked me,' Phillips told the New York Post. 'They were very rough,' she added to the New York Daily News. 'I didn't know what was happening.' She explained to the cops that she had used a temporary Bank of America card to make the purchase - and they demanded to know why her name was not on it. Complaint: Kayla Phillips, 21, says cops demanded to know how she could afford to buy a $2,500 Céline bag from Barneys in New York - in a case that echoes that of a teen accusing the store of racial profiling . Shock: She called her mother Wendy Straker (right with Kayla) who said she heard police ask her daughter: 'What are you doing here in Manhattan? Where'd you get the money to buy that expensive bag?' She called her mother, Wendy Straker, who said that the police officers had asked her daughter: 'What are you doing here in Manhattan? Where'd you get the money to buy that expensive bag?' Straker added that the police were on the phone with a Barneys employee about the transaction. Police finally let her go after she showed them her ID and new debit card, which arrived that morning. 'Jay Z is getting ready to do a campaign with Barneys, but they’re looking at these African-American kids like they're thieves,' Straker said. The case comes after it emerged that another shopper, Trayon Christian, was stopped and handcuffed after he bought a $350 Salvatore Ferragamo belt in the store. Treat: She had just bought a $2,500 orange suede Céline handbag when she was stopped by cops . Christian, 19, has now filed a lawsuit for unspecified damages against the Madison Avenue store and the NYPD who wrongly accused him of fraud. Mr Christian, who lives with his mom in Queens, had decided to splash out on the belt after seeing one of his favorite music stars, Harlem rapper Juelz Santana, wearing the accessory. However once he had paid for the belt and had left Barneys on April 29 this year, the fashion-loving teen was grabbed by undercover officers on the street. According to the civil rights lawsuit, the 19-year-old was asked 'how a young black man such as himself could afford to purchase such an expensive belt'. Mr Christian's lawyer Michael Palillo told the New York Daily News: 'He's never been arrested. His only crime was being a young black guy buying a $300 belt.' Trayon Christian, 19, has brought a lawsuit against Barneys and the NYPD after they wrongly accused him of fraud when he purchased a designer belt . Barneys department store is facing a lawsuit after a 19-year-old black student claims he was wrongly grabbed by store detectives because of his color and accused of stealing a designer belt . A Barneys store employee had asked the 19-year-old for ID when he used his Chase debit card to buy the belt. Mr Christian showed the clerk his state ID. Harlem rapper Juelz Santana (pictured right) wearing the belt coveted by his teenage fan . The store cashier then subsequently called the police to claim that the purchase was a fraud, according to the lawsuit. Officers took the teenager to a local precinct. Mr Christian once again showed his ID, debit card and receipt for the belt. Officers still refused to believe the teenager. Finally Chase bank was contacted who verified that the debit card belonged to Mr Christian. It was only then that he was allowed to go after spending two hours in a holding cell, the suit claims. The NYPD denied this and said the student was only held for 42 minutes. The student, who has no history of arrests, said that he will never shop at Barneys again following the incident. A Barney's New York spokesman said: 'Barneys New York typically does not comment on pending litigation. 'In this instance, we feel compelled to note that after carefully reviewing the incident of last April, it is clear that no employee of Barneys New York was involved in the pursuit of any action with the individual other than the sale. 'Barneys New York has zero tolerance for any form of discrimination and we stand by our long history in support of all human rights.'","The rapper has signed a contract to design an exclusive line for Barneys that will be available next month. The Manhattan superstore stands accused of profiling two young black people, calling the police on both after they purchased expensive items. But Jay-Z defended himself, saying that he hasn't spoken about it because he's still trying to figure out exactly what happened.",1475,61,0.445,0.951 +16,"Police should face time limits on how long a person can languish on bail without being charged, the Home Secretary will say today. Theresa May is demanding action amid mounting anger that police forces are abusing their powers by keeping people in a legal limbo for ‘months or even years’ – only to be told they would not face any action. The issue has been highlighted by a number of high-profile cases, including celebrities and journalists, who have been left on bail for long periods – often with strict curbs to their freedom – without charges being pressed. Theresa May is demanding action amid mounting anger that police forces are abusing their powers by keeping people in a legal limbo for ‘months or even years’ Last week, the veteran disc jockey Paul Gambaccini, arrested in October last year by officers from Operation Yewtree, the inquiry launched in the wake of the late Sir Jimmy Savile being unmasked as a prolific paedophile, was informed he would not face sexual assault charges. The DJ, who was investigated over historic allegations of molesting two teenage boys, told of his ‘12 months of horror and trauma’ having his name dragged through the mud. The College of Policing, the professional body that sets police standards, has expressed concern over suspects being repeatedly re-bailed as it appears to be being used as a ‘quasi-judicial punishment’. Last week, veteran disc jockey Paul Gambaccini (left), arrested in October last year by officers from Operation Yewtree, the inquiry launched in the wake of the late Sir Jimmy Savile (right) being unmasked as a paedophile . The organisation has just concluded a review into how police and other law enforcement agencies use pre-charge bail in criminal investigations. But in a speech to the College’s annual conference in Coventry, Mrs May will order it to consult on introducing time limits on how long a person can spend on bail. Acknowledging it was a ‘sensitive area’, she said: ‘We must also look at statutory time limits on the use of pre-charge bail to prevent people spending months or even years on bail only for no charges to be brought.’ Mrs May declined to propose a possible time limit, but human rights group Liberty and the Law Society have suggested 28 days. Police are allowed 24 hours to keep a suspect for questioning after arrest before seeking a further period of detention from a judge. In practice, they often quiz a person then release them on pre-charge bail to return for further interview at a later date, giving officers time to build robust cases. But there are currently no restrictions on the length of time a person can spend on police bail which can force innocent people to put their lives on hold, pay thousands in legal fees and suffer the slow assassination of their characters. Conditions can also be placed on police bail, which can include curfews and restrictions on movement and financial transactions while an investigation continues. Comedian Jim Davidson (left) lashed out at the system after being kept on bail for eight months before being told he would not face any charges. Freddie Starr (right), another comedian, spent 19 months on bail after being arrested by officers investigating decades-old sex allegations made by 14 women . Comedian Jim Davidson lashed out at the system after being arrested under the Operation Yewtree and kept on bail for eight months before being told he would not face any charges. Freddie Starr, another comedian, spent 19 months on bail after being arrested by police investigating decades-old sex allegations made by 14 women. The case was dropped. Conservative MP Nigel Evans – who resigned as House of Commons deputy speaker before being cleared of sex assault charges in court in April – described the ‘indescribable torment, torture and stress’ of being left hanging on bail. He was eventually acquitted by a court of all charges of sexually assaulting Parliamentary researchers. Some 30 journalists are currently on bail – some for more than a year – while police investigate alleged crimes including phone hacking and paying public officials for stories. A Freedom of Information request in May last year found more than 57,000 people were on police bail at the time with more than 3,000 bailed for more than six months. Lord Macdonald, the former Director of Public Prosecutions, said recently: ‘There is sometimes a lack of urgency in police bail cases that is very worrying. Lives are put on hold and grave reputational damage goes unchecked, sometimes for years.’ Keith Vaz, the Labour chairman of the Home Affairs Select Committee, raised the issue during an evidence session with Alison Saunders, the Director of Public Prosecutions. Referring to the 30 journalists on bail who do or did work for The Sun or now-defunct News of the World, he said: ‘They have been bailed and rebailed without being charged and have had their careers ruined because they have been suspended or lost their jobs. ‘It can’t be right that these people keep getting bailed and re-bailed.’ Sorry we are not currently accepting comments on this article.","Theresa May is demanding action amid mounting anger that police forces are abusing their powers by keeping people in a legal limbo for ‘months or even years’ The issue has been highlighted by a number of high-profile cases, including celebrities and journalists who have been left on bail for long periods.",850,51,0.486,0.922 +17,"Two Second World War Lancaster bombers flew together in the skies over Britain yesterday for the first time in 50 years. The world's only two airworthy Lancaster bombers were united on a windswept Lincolnshire airfield for what will probably be one of the last times. The Lancaster Thumper, which is part of the RAF Battle of Britain Memorial flight, joined the Canadian Lancaster Vera from a museum in Ontario. Scroll down for video . Off they go: This Ministry of Defence photograph shows spectators watching as two Lancaster Bombers prepare to fly in Coningsby, Lincolnshire . Together: The Lancaster Thumper, which is part of the RAF Battle of Britain Memorial Flight has been joined by the Canadian Lancaster Vera from Ontario . The two aircraft - pictured at RAF Coningsby - are expected to visit some 60 air shows and public events across the UK over the next five weeks. The planes had been due to pass over Lincoln Cathedral last Friday, but poor weather caused the flight to be postponed. MailOnline reported last Saturday on . how Vera had arrived in Lincolnshire following an epic 3,700-mile . journey to Britain from her base in Canada. Aircraft enthusiast Matthew Munson, . from Henley-on-Thames, Oxfordshire, bid £43,000 on eBay for the . privilege of flying in the bomber. Up in the air: The two aircraft are expected to visit some 60 air shows and public events across the UK over the next five weeks . On the tarmac: The world's only two airworthy Lancaster bombers were united on a windswept RAF Coningsby for what will probably be the last time . Leon Evans, chief pilot for the . Canadian Lancaster’s historic trip, said: ‘We haven’t had two Lancasters . fly together in a display before. ‘It’s pretty unlikely it’ll happen . again because these airplanes might run out of airtime. Vera’s getting . older and already has about 4,500 hours on her.’ Vera’s journey from Canada took four . days, involving stops in Newfoundland, Greenland and Iceland before she . arrived in Lincolnshire on Friday. More than 7,377 Lancasters, 430 of . which were built in Canada, were made during the Second World War but . many that survived were scrapped. 14-17 August - 'Airbourne' International Air Show - www.visiteastbourne.com/airbourne - Eastbourne, East SussexSaturday 16 August - Flying Proms - www.shuttleworth.org/tickets/event-details.asp?ID=268 - Old Warden, BedfordshireSaturday 16 and Sunday 17 August - Combined Ops 2014 - www.headcornevents.co.uk/event_ticket.php - Headcorn Aerodrome, KentSunday 17 August - Bay Day Air Display - http://baypromoteam.co.uk/bay-day-air-display-sun-17th-august/ - Herne Bay, KentSunday 17 August -Sywell Airshow - http://sywellairshow.co.uk/ - Sywell, NorthamptonshireThursday 21 August - RAF Marham Families Day - RAF Marham, NorfolkThursday 21 and Friday 22 August - Clacton Air Show 2014 - www.clactonairshow.com - Clacton-on-Sea, EssexSaturday 23 August - Dawlish Air Show - www.dawlishairshow.co.uk/ - Dawlish, DevonSunday 24 August - Dunsfold Wings & Wheels 2014 - www.wingsandwheels.net/ - Dunsfold Aerodrome, SurreySunday 24 August - Little Gransden Air & Car Show - http://www.littlegransdenshow.co.uk/ - Little Gransden, Cambridgeshire28-30 August - Air Festival 2014 - www.bournemouthair.co.uk/ - Bournemouth, DorsetSaturday 30 August - Shoreham Air Show 2014 - Shoreham, West SussexSaturday 30 August - Dartmouth Royal Regatta - www.dartmouthregatta.co.uk - Dartmouth, UKSunday 31 August - Air Festival 2014 - www.bournemouthair.co.uk - Bournemouth, DorsetSunday 28 September - Battle of Britain Memorial Flight - www.lancasterassociation.co.uk - RAF Coningsby in Lincolnshire . Beautiful sight: The Avro Lancaster is one of the Second World War's most-recognisable British aircraft . Famous film: A scene from 1955 movie The Dam Busters - released 12 years after the raid - showing the bouncing bomb suspended from the belly of the Lancaster . The Avro Lancaster is one of the Second World War's most-recognisable British aircraft. It is most famous for the Dambusters . raids, which saw 19 Lancasters attack German dams with Sir Barnes . Wallis's 'bouncing bombs' in 1943. Vera - built two years after the raids, in 1945 - was acquired by Canadian Warplane Heritage Museum in 1978 and . underwent a 10-year restoration. Lord of the Rings director Peter Jackson has also been on board the bomber in preparation for a new film about the Dambusters. On May 16, 1943, 19 aircraft set out . to destroy three dams in the Ruhr valley - the Mohne, the Eder and the . Sorpe. The idea was to damage a vital source of power to the key industrial area of Germany. The strategic targets not only supplied hydro-electric power, and water for steel-making, but also supplied drinking water. The squadron was assembled by Wing . Commander Guy Gibson with only 11 weeks to prepare for their mission - . using special bouncing bombs, invented by Barnes Wallis. They were not told that they would be . bombing the Ruhr valley until six hours before the raid began, following . weeks of practice over Peak District reservoirs. On the night of the mission - . codenamed Operation Chastise - the 113 crewmen took off in three waves . along two different routes to bomb the dams. Gibson attacked first at the Möhne at 12.28am, but five bombs were dropped before it was breached. The first wave’s three remaining aircraft with bombs then attacked the Eder which finally collapsed at 1.52am. Aircraft from the other two waves . bombed the Sorpe but it remained intact. Although the mission was hailed . a success, eight aircraft and 53 crew were lost during the raids.","The Lancaster Thumper joined the Canadian Lancaster Vera from a museum in Ontario. The two aircraft are expected to visit some 60 air shows and public events across the UK over the next five weeks. The planes had been due to pass over Lincoln Cathedral last Friday, but poor weather caused the flight to be postponed.",902,56,0.491,0.839 +18,"Andy Murray knows there can be no let up in his quest to secure a place at the season-ending ATP World Tour Finals as he heads to Valencia on the back of a hard-earned victory over David Ferrer in the final of the Erste Open in Vienna. The British number one recovered from losing the opening set to break serve three times in the decider and clinch a 5-7 6-2 7-5 victory in two hours and 40 minutes, which earned him crucial points in the Race to London. Murray, 27, is now the holder of the eighth and final qualifying berth for tournament hosted at The O2, with Tomas Berdych's win against Grigor Dimitrov in the final of the Stockholm Open later on Sunday consolidating the Czech's seventh position. Andy Murray lifts the Erste Open trophy in Vienna after a three set victory against David Ferrer . The Scot is now in position to reach the World Tour Finals after moving into the eighth qualifying position . The margins, though, are slim heading into the last two ranking events of the regular 2014 season, the Valencia Open 500, where Murray will play, and the Swiss Indoors Basel preceding the BNP Paribas Masters, which carries double the qualification points. Some six players are realistically left chasing the three remaining places, with Marin Cilic, who on Sunday won the Kremlin Cup in Moscow, qualified as a Grand Slam winner, from the US Open. 'The next few weeks are extremely important, everyone is playing next week,' said Murray on www.atpworldtour.com. 'I just need to win as many matches as possible to keep hold of the eighth spot or go higher.' Murray will now compete at the Valencia Open 500 as he bids to secure his position in London . Murray has been battling to regain top form again this year, the 2013 Wimbledon champion having fallen down the world rankings to number 11, but he claimed the inaugural Shenzhen Open title at the end of September and now after Vienna has some 30 ATP Tour wins. He added on BBC Radio Five Live: 'I was starting to feel good at the US Open a few months ago and I wanted to try and continue that through until the end of the year. 'Obviously, London would be very nice if I can get there, but it is also important for seedings at the Australian Open. 'To be seeded in the top eight there can make a big difference to the draw and hopefully I will be able to do that.' David Ferrer, pictured playing a backhand shot against Murray, could also make the World Tour Finals . Ferrer, meanwhile, still harbours genuine hopes of making it to London - the Spaniard is currently in ninth place but only 100 points behind the Scot going into Valencia. 'I have reached the final (here), so it is positive,' said Ferrer, who had beaten Murray in the third round of last week's Shanghai Rolex Masters. 'Andy played more aggressively than I did in the crucial moments and he deserved to win. 'Of course, I am disappointed as I lost the match having had a 5-3 lead (in the third set). 'I have a chance (to qualify for London). There are two more weeks, which are important to get to London. I will try and be more positive next week.'",Andy Murray beat David Ferrer 5-7 6-2 7-5 in the final of the Erste Open in Vienna. The Scot is now in position to reach the World Tour Finals after moving into the eighth qualifying position. Tomas Berdych beat Grigor Dimitrov in the Stockholm Open final.,562,46,0.552,0.804 +19,"A lifelong dream becomes reality for Chris Cork in Buenos Aires on Sunday, as the former punk rocker from High Wycombe sits on his bike to begin the world’s most punishing motorsport event. The 43-year-old Englishman, a builder by trade, will put his bike, body and possibly even his life on the line during the Dakar, the 5,500-mile race across the Andes and the Atacama desert. He has left his partner and two sons, including three-month-old Oliver, behind and even sold their farm to fund his ride of a lifetime. Chris Cork is set to embark on the the 5,500-mile Dakar race across the Andes and the Atacama desert . Cork, a builder by trade, has left his partner and two sons to embark on his race of a lifetime . ‘He’s always wanted to do the Dakar, it’s been a dream of his,’ said partner Mel, who remains confident, if a little anxious. ‘He’s quite a safe rider, it’s just everything else that goes into the equation that worries me. It’s a bit of a mixed bag because I’m excited for him but obviously it’s a bit tricky here for the next three weeks with two young kids.’ And that’s also the hardest part for Cork, who once upon a time played drums and bass in punk bands Chineapple Punx and Blossom, but nowadays is found doting on Mel and the children. ‘I have pictures of my two sons with me at all times and I miss them greatly,’ he said. Thoughts of home will disappear on Sunday, however, when Cork lines up at the start of one of the most gruelling and dangerous of all races. A total of 665 competitors will leave Buenos Aires in cars and trucks and on quad bikes and motorcycles. British interest is restricted to a mere eight racers, a far cry from the heyday of the old Paris-Dakar when dozens of home hopefuls would cross the Channel and begin the epic journey down to Dakar in Senegal. Cork will be one of 665 competitors racing in in cars and trucks and on quad bikes and motorcycles . Cork, whose preparations for the rally have not been ideal - he broke his wrist in August and crashed out of the Rally of Morocco in October - is Britain’s only amateur rider this year, though Paul Round from Huddersfield and Mike Jones, from Sandbach, founders of Rally Raid UK, continue to fly the flag in all categories, taking four cars, two trucks and two bikes. Crossing the barren terrain of Argentina, Chile and Bolivia sounds daunting enough, but Jones paints an even scarier picture. ‘The Dakar is an addiction, it takes over your life,’ he explained. ‘The organisation are out to break you and your vehicle, simple as that. ‘Some of the terrain looks mind blowing when you see it and you never believe a vehicle can cross it, let alone at speed. ‘You can be 3km off track and still be classed as on course, yet a 10-metre deviation in the desert can be a smooth fast track or a 500ft-deep canyon. The route designer puts secret waypoints that must be passed by into the most devilish places, at the top of the steepest dunes and the bottom of the biggest holes and sand pits. ‘In the daylight it is difficult, when the sun goes down it really sorts the men from the boys or the girls from the women.’ 43-year-old's preparations have been far from ideal having broken a wrist in August . Of the eight British competitors at Dakar this year it is with Cork’s sole compatriot in the bike category, Sam Sunderland, where British hopes lie. Sunderland, 25, has secured a ride with the dominant KTM squad, on the back of taking the second stage win riding a works Honda in last year’s Dakar. For Cork, however, ambitions are more modest. Given what lies ahead, the endless tests over unyielding surfaces, in extreme temperatures, from sea level to the peaks of the Andes and back, he speaks for the majority when he says: ‘My expectation is simply to finish.’ Britain's Sam Sunderland will be riding at Dakar with the dominant KTM squad .","Chris Cork is set to embark on the 5,500-mile Dakar race across the Andes and the Atacama desert. The 43-year-old Englishman will put his bike, body and possibly even his life on the line during the Dakar. Cork has left his partner and two sons behind and even sold their farm to fund his ride of a lifetime.",703,58,0.545,0.759 diff --git a/examples/streamlit/annotation/images/wandb-logo.png b/examples/streamlit/annotation/images/wandb-logo.png new file mode 100644 index 00000000..947fb5d7 Binary files /dev/null and b/examples/streamlit/annotation/images/wandb-logo.png differ diff --git a/examples/streamlit/annotation/images/wandb-streamlit-logo.png b/examples/streamlit/annotation/images/wandb-streamlit-logo.png new file mode 100644 index 00000000..bba3e7a8 Binary files /dev/null and b/examples/streamlit/annotation/images/wandb-streamlit-logo.png differ diff --git a/examples/streamlit/annotation/requirements.txt b/examples/streamlit/annotation/requirements.txt new file mode 100644 index 00000000..3a8cebe9 --- /dev/null +++ b/examples/streamlit/annotation/requirements.txt @@ -0,0 +1,2 @@ +pandas==2.1.2 +streamlit==1.28.1 \ No newline at end of file diff --git a/examples/streamlit/annotation/samsum_original.csv b/examples/streamlit/annotation/samsum_original.csv new file mode 100644 index 00000000..96cb942f --- /dev/null +++ b/examples/streamlit/annotation/samsum_original.csv @@ -0,0 +1,21 @@ +,articles,bart_samsum_summaries,source_word_count,source_lexical_diversity,summary_word_count,summary_lexical_diversity +0,"By . Chris Parsons . PUBLISHED: . 02:41 EST, 22 June 2012 . | . UPDATED: . 03:12 EST, 22 June 2012 . Segolene Royal reignited her row with the French First Lady last night when she blamed Valerie Trierweiler for her presidential election defeat to Nicolas Sarkozy. The pair had becomed embroiled in a political spat last week when it emerged that Miss Trierweiler had tweeted support for a politician standing against Miss Royal, 58, in parliamentary elections. A presidential aide said Miss Trierweiler, 47 – nicknamed the Rottweiler – had since been told to ‘stay in the shadows’ because president Francois Hollande was ‘furious’ at her intervention. Backtrack: France's controversial new first lady Valerie Trierweiler (left) now 'regrets' humiliating the mother of the President's four children Segolene Royal (right) But the row dubbed the 'the war of the . roses' erupted again last night when Miss Royal, who said she was . 'wounded' by the 'violent blow', claimed Miss Trierweiler had been . undermining her career for years since starting a relationship with her . ex-partner. Miss Segolene, the mother of President . Hollande's four children, had already accused senior Socialist . politicians of not being supportive enough in her 2007 campaign. But she went a step further in an . interview with French weekly Le Point yesteryday, claiming France's . first lady had kept Mr Hollande away from her during the campaign. She said: 'I realise that in 2007 (Mr . Hollande's affair with Trierweiler) can't have helped matters. I now . understand why François didn't help me. 'In 2007, I said to myself: 'It will pass, it'll work itself out.' So I took it on the chin.' Miss Royal is said to have told friends that Miss Trierweiler is a 'traitor' who her treated her disgracefully. Ms Trierweiler took to Twitter to announce her support for socialist Olivier Falorni . Miss Royal said it was unfair that . Miss Trierweiler had been allowed to carry on writing about Mr Hollande . in her 'Paris Match' arts column. Miss Royal told Le Point: 'In an . Anglo-Saxon country, she would have been fired the same day. But Paris . Match was not unhappy to see me weakened, so they let (the relationship) go on deliberately, just like all those others who knew ...(Paris Match . owner) Lagardère, Sarkozy.' Her outburst finished when she claimed that 'I'm the one whose family has been broken, I'm, the one who should bear a grudge.' France's first lady said last night she regretted humiliating the mother of the president’s four children. Mr Hollande, who lived with Miss Royal . for 30 years, wanted to make her the speaker of the National Assembly . but backed down when she lost the election. Telling off: Following Valerie Trierweiler's (pictured right) Twitter comments, Prime minister Jean-Marc Ayrault said 'everyone should know their place' A friend of Miss Trierweiler said she admitted: ‘I made a mistake.’ The friend added: ‘She did not calculate the consequences.’ Ms Trierweiler, who has been divorced . twice, has three sons of her own and said that the only reason she had . not travelled to Mexico with Hollande for the G8 meeting was because . they have exams this week. Intriguingly, Ms Trierweiler's . personal biography has disappeared from the Elysee Palace website, but . another aide insisted that it was 'being edited' and would return. But the same aide confirmed that Ms . Trierweiler was being encouraged to 'remain in the shadows'  because Ms . Hollande was 'furious' at the way she has behaved so far. Glamour: Hollande initially painted himself as an antidote to the flash previous President Nicolas Sarkozy, who married model Carla Bruni . Referring to the tweet, he said 'clearly this cannot happen again'. Despite the continuing saga which has . reduced the Elysee to a soap opera, journalist Ms Trierweiler's arts . column is set to appear in Paris Match magazine this week. And she has insisted she will not give up her Twitter account. Mr Hollande has now refused to give Ms Royal a job because she lost the La Rochelle seat in western France so heavily. But, despite consistent defeats since . being rejected for the presidency in 2007, Ms Royal insists that she can . revive her political career.","Segolene Royal lost the presidential election to Nicolas Sarkozy. Valerie Trierweiler tweeted support for a politician standing against Miss Royal in parliamentary elections last week, which reignited a political spat between the two women. A presidential aide said Miss Trierwiler, 47, was not responsible for Segolene's defeat.",719,0.517,47,0.872 +1,"By . Damien Gayle . PUBLISHED: . 08:10 EST, 12 October 2012 . | . UPDATED: . 09:36 EST, 14 October 2012 . A spinoff from robotic space technology may someday help astronauts stay fit in space and help paraplegics walk on Earth, Nasa says. The U.S. space agency and the Florida Institute for Human and Machine Cognition (IHMC) have jointly developed a robotic exoskeleton called X1. The 57lb device is a robot that a human could wear over his or her body either to assist or inhibit movement in leg joints. Scroll down for video . Dual use: The X1 exoskeleton, currently in development, could help astronauts exercise in space and paraplegics walk on Earth. It is based on the technology behind Robonaut 2, the first humanoid robot in space . In the inhibit mode, the X1 exoskeleton would be used as an in-space exercise machine to supply resistance against leg movement. The same technology could be used in reverse on the ground, potentially helping some individuals walk for the first time. The X1 is based on the technology behind Robonaut 2, the first humanoid robot in space, which is currently working with astronauts aboard the International Space Station. 'Robotics is playing a key role aboard the International Space Station and will be critical in our future human exploration of deep space,' said Michael Gazarik, director of Nasa's Space Technology Program. 'What's extraordinary about space technology and our work with projects like Robonaut are the unexpected possibilities space tech spinoffs may have right here on Earth. 'It's exciting to see a Nasa-developed technology might one day help people with serious ambulatory needs to begin to walk again, or even walk for the first time. 'That's the sort of return on investment Nasa is proud to give back to America and the world.' Nasa's Robonaut 2 aboard the International Space Station: The technology for the X1 exoskeleton was adapted from the Robonaut project . From the waist up, 27-year-old Sophie Morgan is every inch the pretty blonde girl-next-door. But from the waist down, with her legs encased in £90,000 of motorised carbon-fibre, she is RoboCop. Sophie’s thumb manipulates a joystick built into the armrests of her suit, causing the legs to hiss and whirr into life, before she takes three slow but sure steps. Her face breaks into a broad grin. Nasa's X1 prototype is not the only exoskeleton in development that could help disabled people walk again. Sophie is one of the first people in the world to benefit from a robotic exoskeleton called Rex. Once in, the only movement needed is the strength to operate a small joystick, which instructs 29 micro-controllers within the machine to react within milliseconds. The user can move in all directions, sit down, and ascend and descend stairs. It is this technology that will, arguably, mark the end of the wheelchair. But as yet there are currently just ten in existence and only 30 people have tried Rex. Rex weighs nearly 6st and is relatively bulky, yet experts predict that within the next few decades the devices will be small and light enough to slip on under a pair of jeans. Worn over the legs, with a harness . that reaches up the back and around the shoulders, X1 has four motorised . joints at the hips and the knees, and six passive joints that allow for . sidestepping, turning and pointing, and flexing a foot. There also are multiple adjustment points, allowing the X1 to be used in many different ways. Nasa is examining the potential for the X1 as an exercise device to improve crew health both aboard the space station and during future long-duration missions to an asteroid or Mars. Without taking up valuable space or weight during missions, X1 could replicate common crew exercises, which are vital to keeping astronauts healthy in zero gravity. In addition, the device has the ability to measure, record and stream back data in real-time to flight controllers on Earth, giving doctors better insight into the crew's exercise. X1 could also provide a robotic power boost to astronauts as they work on the surface of distant planetary bodies. Coupled with a spacesuit, X1 could provide additional force when needed during surface exploration. Here on Earth, IHMC is interested in developing and using X1 as an assistive walking device. It has the potential to produce high torques to allow for assisted walking over varied terrain, as well as stair climbing. 'We greatly value our collaboration with Nasa,' said Ken Ford, IHMC's director and CEO. 'The X1's high-performance capabilities will enable IHMC to continue performing cutting-edge research in mobility assistance and expand into rehabilitation.' The potential of X1 extends to other applications, including rehabilitation, gait modification and offloading large amounts of weight from the wearer. Preliminary studies by IHMC have already shown X1 to be more comfortable, easier to adjust, and easier to put on than older exoskeleton devices. Researchers now plan on improving on the X1 design by adding more active joints to areas such as the ankle and hip to increase the potential uses for the device.",Nasa and the Florida Institute for Human and Machine Cognition have jointly developed a robotic exoskeleton called X1. The 57lb device is a robot that a human could wear over his or her body to assist or inhibit movement in leg joints. It could help astronauts stay fit in space and help paraplegics walk on Earth.,853,0.523,56,0.857 +2,"A father who imported a stun gun disguised as an iPhone walked free from court yesterday. John Liddiatt, 40, ordered the device online while browsing collectible replica weapons. But when suspicious customs officers investigated the parcel from Singapore they found the replica iPhone and immediately passed it to the police. Walking free: John Liddiatt (pictured) was sentenced to 12 months imprisonment, suspended for a year . Officers confirmed the device was a weapon and it was re-wrapped before being delivered to Liddiatt at his home address. The dad-of-three was immediately arrested and confessed he had ordered the device, but claimed he had no idea it would be real because of its cheap price. Liddiatt, of Broad Walk, Knowle, Bristol, admitted one count of acquiring a disguised firearm at Bristol Crown Court and was sentenced to 12 months imprisonment, suspended for a year. The black phone, which is in a cover, came with a charger and has two prongs in the bottom which act as pins for the stun gun. Sentencing, Judge Martin Picton told him: 'It is a pretty poor imitation of an iPhone of some description in a box that is meant to look real.' The court heard how weapon collector Liddiatt ordered the stun gun on December 5 2013 from a website he usually used to purchase replica items. George Threlfall, prosecuting, said: 'On December 19 a package was sent from Singapore, addressed to Liddiatt at his home address. 'It was intercepted by customs and officers opened it and revealed what they believed to be a stun gun device. 'This was passed on to police and following examination, firearms officers who confirmed it was a stun gun with the appearance of a mobile phone.' Police then re-packaged the device before an officer, dressed as a postman, delivered it to Liddiatt's home. Unrealistic: Judge Martin Picton told Liddiatt: 'It is a pretty poor imitation of an iPhone of some description in a box that is meant to look real' Weapon: The black phone, which is in a cover, comes with a charger and has two prongs in the bottom which act as pins for the stun gun . He told officers he was an avid collector of replica crossbows, swords and masks which had appeared in movies and did not realise it was an offence to import the stun gun. Jane Chamberlin, defending Liddiatt, said: 'We have a defendant who has kept the item under the stairs and who volunteered it to police. 'It was not going to be put out in the public domain.' After the sentencing, Avon and Somerset police warned of the risks of importing illegal weapons over the internet. Investigating officer PC Chris Downham said: 'It is imperative that items bought from abroad and imported into this country are legal according to UK laws. 'Stun guns like the ones seized in this case are prohibited and dangerous weapons capable of causing considerable harm. 'It's the responsibility of the buyer to ensure they are complying with the law before ordering items over the internet. 'Liddiatt had tested the items when they arrived and was fully aware they were a viable working device.' Liddiatt was also ordered to carry out 200 hours of unpaid work.","John Liddiatt, 40, imported a stun gun disguised as an iPhone from Singapore. He was sentenced to 12 months imprisonment, suspended for a year, but walked free from court yesterday. He ordered the device online while browsing collectible replica weapons. Customs officers found the device when they investigated the parcel.",538,0.507,50,0.88 +3,"February 10, 2015 . Economics, international politics, rocket science and careers are four subjects explored this Tuesday on CNN Student News. First up: U.S. cities like Boston are strapped for cash when it comes to their snow-removal budgets. Then, we examine why approval ratings are high for Russia's president despite the strains on his nation's economy. We'll explain the big goal of an upcoming rocket launch and look at the salaries of photographers and helicopter pilots. On this page you will find today's show Transcript and a place for you to request to be on the CNN Student News Roll Call. TRANSCRIPT . Click here to access the transcript of today's CNN Student News program. Please note that there may be a delay between the time when the video is available and when the transcript is published. CNN Student News is created by a team of journalists who consider the Common Core State Standards, national standards in different subject areas, and state standards when producing the show. ROLL CALL . For a chance to be mentioned on the next CNN Student News, comment on the bottom of this page with your school name, mascot, city and state. We will be selecting schools from the comments of the previous show. You must be a teacher or a student age 13 or older to request a mention on the CNN Student News Roll Call! Thank you for using CNN Student News!","This page includes CNN Student News stories on economics, international politics, rocket science and careers. Today's stories cover: U.S. cities like Boston are strapped for cash when it comes to snow-removal budgets, why approval ratings are high for Russia's president despite the strains on his nation's economy and salaries of photographers and helicopter pilots.",239,0.64,54,0.889 +4,"By . James Rush . PUBLISHED: . 10:51 EST, 5 April 2013 . | . UPDATED: . 11:17 EST, 5 April 2013 . Four people including a three-year-old boy remained critically ill this afternoon after a devastating blaze tore through a family home. Eight people, all but one from the same family, were rescued from the terraced, two-storey property in Honiton, Devon. A 17-year-old girl and an 18-year-old man were in a serious condition at the Royal Devon and Exeter Hospital while a man in his 30s was also seriously ill from inhaling smoke. The toddler also suffered serious injuries and was taken to Frenchay Hospital in Bristol. Another boy aged six was discharged from hospital. A three-year-old boy, two teenagers and a man in his 30s were seriously injured in hospital following a fire at this family home . Police have said officers were called to a house fire at a property in Honiton, East Devon, shortly before 8am, along with firefighters and the air ambulance. Neighbour Dave Joslin, a former firefighter, said he was woken up by the sound of fire engine sirens. He said: 'I looked out of my window and saw smoke billowing out of the upstairs window and thought, I hope no one's hurt. When I saw five fire engines outside, I knew it was serious.' Police and fire investigators remained at the scene today as inquiries were carried out. Chief . Superintendent Paul Davies, speaking from the scene, said: 'There is . nothing to suggest the cause of the fire is suspicious. But now there is . a multi-agency approach to determine the cause. 'Two . young adults and a young child were taken to hospital. The other five . are either at a hospital, being looked after by police or are with . friends. Emergency services were called to the house in Lee Close, Honiton, shortly before 8am . Police have said an investigation is underway, although there was nothing to suggest the cause was suspicious . 'It is understood a family member in the house raised the alarm. The house is badly damaged.' Mr Joslin said: 'From what I can see the fire was pretty extensive. The windows are completely out and it's pretty well blackened. 'There were five fire engines and five ambulances there at one stage. It was a shock looking out and seeing it this morning. Police and fire investigation officers remained at the scene to carry out their inquiries . 'You think, ""blimey I do hope nobody's hurt"" especially when I didn't hear anything.No explosions or anything like that. I just heard the fire engines going up.' South Western Ambulance Service said they were called to the incident at 7.36am. A spokesman said: 'The trust immediately dispatched a number of vehicles including one of the Devon air ambulances. Five ambulances and two officers were also promptly on scene, with the first vehicle arriving within four minutes. 'Members of the Hazardous Area Response Team (HART) were also in attendance. These highly trained paramedics have specialist equipment to deal with this type of situation. 'A number of casualties were treated at the scene for smoke inhalation. Four people, all thought to be in a life-threatening condition, have been taken to the Royal Devon and Exeter Hospital.' Neighbour Dave Joslin, a former firefighter, said he was woken up at about 7.30am to the sound of fire engine sirens . Police have said it was believed a family member raised the alarm .","A three-year-old boy and two other people remain critically ill after a house fire in Honiton, Devon. Eight people were rescued from the terraced, two-storey property, all but one from the same family. A 17-year old girl and a man in his 30s are in a serious condition in hospital.",581,0.508,50,0.8 +5,"By . Daily Mail Reporter . PUBLISHED: . 19:11 EST, 3 May 2013 . | . UPDATED: . 03:52 EST, 4 May 2013 . Three human skeletons discovered in a hole dug for a septic tank in Oklahoma last month are most likely those of three females we went missing in 1992 authorities have announced. Grover J. Prewitt Jr., 60, of Bristow was arrested on Thursday after having admitted to police of having sprinkled black pepper over the grave to mask any odor, but under the direction of his mother he claims. The bodies are likely Wendy Camp, 23; her daughter Cynthia Britto, 6; and Lisa Kregear, 22, who was Camp's sister-in-law, the Oklahoma State Bureau of Investigation said. Missing: From left Wendy Camp, 23, her daughter Cynthia Britto, 6, and Lisa Kregear, 22, are pictured after vanishing on May 29 of 1992 . Clothing, a backpack and a purse were found in the 8-feet-deep hole near Jennings, matching items the women had when they disappeared on May 29 of 1992. Prewitt used to own the land where the bodies were found and was charged with being an accessory after the fact of first-degree murder. Investigators said he told them that he suspected in 1992 that the three were in the hole and said he spread pepper in the area at his mother's request. Prewitt's mother, Ida Prewitt who died in September of 2011, was in a bitter custody battle with Camp at the time of her disappearance having been married to Prewitt's nephew, according to investigators. In late March, Grover Prewitt told investigators that, around the time the three disappeared, his sister Beverly Noe asked him to hire a backhoe driver to dig a hole for a septic tank on 5 acres that their mother was buying from him. Accessory: Grover J. Prewitt Jr., 60, of Bristow, told police his mother Ida Prewitt, right, ordered him to dig the hole for a septic tank where the bodies were later found . The hole sat empty for a bit, then after the three went missing his mother asked him to have the backhoe driver fill the hole. Ida Prewitt never moved onto the property and later sold it. 'Grover never looked in the hole after the girls went missing because he was scared of what he would see,' agent Melissa Gann wrote in an affidavit filed in Creek County Court. Investigators have since accused Noe of being the last to have seen the three victims after driving them to Walmart. 'I never hurt nobody,' Noe told KFOR. 'I took ‘em to the Walmart. I’ll say that to my dying days.' Five days after his initial meeting with police, Prewitt met again with investigators and told one 'he really needed to look in that hole.' On April 16, crews found three bodies inside. In an interview with police on April 22, he recalled his mother asking him to sprinkle black pepper on the area. Scene: The remains were found on this private property in Pawnee County last month in an 8-foot hole that Grover Prewitt says his mother told him to sprinkle black pepper over to mask any odor . 'He told her he thought that was ""awful damn strange."" She said it would ""deter dog scents."" Grover did not question her on that matter and did as he was asked,' Gann wrote. 'He also remembered Ida saying one time she ""took care"" of those three people,' Gann wrote. Ida Prewitt died in September 2011, the investigators said. The OSBI wouldn't speculate on why Grover Prewitt stepped forward now. 'After 21 years, a lot changes in people's lives,' OSBI spokeswoman Jessica Brown said. Creek County officials did not have a record of any attorney for Prewitt. DNA testing is pending to determine definitely whether the bodies are those of the missing women and the girl. 'Now that it is open and out in the public, we need people to come forward,' she said. 'There are other people who know about this.' At a news conference Thursday, OSBI Director Stan Florence credited Prewitt's recent revelations – at the same time agents were moving in to arrest him. 'The passage of 21 years gave a tipster confidence to come forward and provide the information necessary to help push this case forward,' Florence said at the time. According to the investigators, Camp's son, 4-year-old Jonathan Noe, lived with Chad Noe in Shamrock. Chad Noe's mother, Beverly Noe, told investigators in 1992 that she drove the three to and from Shamrock, then dropped them off at a Wal-Mart in Chandler. Jennings is about 100 miles northeast of Oklahoma City and the grave site is about 19 miles from Shamrock and 30 miles from Chandler.","Grover J. Prewitt Jr., 60, of Bristow, Oklahoma, admitted to police that he sprinkled black pepper over the grave to mask any odor, but under the direction of his mother. Three human skeletons discovered in a hole dug for a septic tank are most likely those of three females who went missing in 1992.",789,0.485,54,0.889 +6,"By . James Rush . PUBLISHED: . 06:02 EST, 30 September 2013 . | . UPDATED: . 06:10 EST, 30 September 2013 . Swift action: Sheik Mohammed has ordered an investigation into the seizure . The owner of the scandal-hit Godolphin stable has ordered a new investigation after banned equine drugs were discovered on a Dubai government private jet when it was searched at Stansted airport. Officers from the UK Border Agency, along with the Veterinary Medicines Directorate, seized the unlicensed products from a Dubai Royal Air Wing flight earlier this year, it has been reported. Sheikh Mohammed bin Rashid Al Maktoum, monarch of the gulf emirate, has now ordered his junior wife Her Highness Princess Haya, president of the International Federation for Equestrian Sports, to carry out an investigation into the incident. The inquiry comes just weeks after a separate raid at Moorley Farm in Newmarket, which is owned by Godolphin’s Darley Management operation. According to The Guardian, the shipment, apparently labelled as 'horse tack', did not include anabolic steroids. It is believed the seizure did however contain products used on endurance horses. A spokesman for Princess Haya told the Guardian: 'Nobody seems to know in the organisation who is buying what or where. That’s one of the reforms that they want in place.' The spokesman said Sheik Mohammed had been unaware of the products on the flight as well as the raid at Moorley Farm. The spokesman also said Sheikh Mohammed's operation had not been spoken to by the VMD since the seizure and blamed the presence of the drugs on 'an internal reporting error'. Sheikh Mohammed's senior wife is Shaikha Hind bint Maktoum bin Juma Al Maktoum, a member of Dubai's ruling family Al Maktoum, who he married in 1979. His most famous junior wife is Princess Haya, who he married on April 10, 2004. Statement: A spokesman for Princess Haya (right) has said Sheikh Mohammed's (left) operation had not been spoken to by the VMD since the seizure . The British Horseracing Authority has . said it has been told by Defra there was no link between the seizure . and the racing industry. Adam . Brickell, the BHA's director of integrity, legal and risk, said: 'This . issue is a matter for Defra and the VMD, the agency responsible for . issues concerning the use and manufacture of veterinary medicines in . Britain. 'On account of our existing working . relationship with Defra and the VMD, as fellow regulatory authorities . with responsibilities for animals and their welfare, the BHA was . notified of the seizure of veterinary care products, some of which are . not licensed for use in the UK. 'Defra . have confirmed to the BHA that they consider there to be no link . between the seizure and the racing industry and that the products were . not intended for use on thoroughbreds.' A Border Force spokesman said the products seized at Stansted had now been destroyed. The spokesman told MailOnline: 'On May 3 Border Force officers at Stansted identified a quantity of veterinary products on a private plane that arrived at the airport. 'The products, which were unlicensed, had been listed as horse tack and were seized by officers. Illegal drug use: Former Godolphin trainer Mahmood al-Zarooni was banned for eight years after anabolic steroids were used on 22 horses in the stable . 'DEFRA (the Department for Environment, . Food and Rural Affairs) was contacted and confirmed Border Force . officers' identification of the medicines, which were subsequently . removed and destroyed. 'Border Force officers are on constant . alert to keep unlicensed, fake and illegal items from entering the . country — including veterinary products.' In April, former Godolphin trainer Mahmood al-Zarooni was banned for eight years after anabolic steroids were used on 22 horses in the stable. Earlier this month it was reported Sheikh Mohammed was embroiled in another drugs controversy after 124 unauthorised veterinary products were seized at Moorley Farm East in Newmarket. The farm, which is owned by Darley Stud, the banner company of his breeding operation, was the subject of a swoop in August by DEFRA (Department for Environment, Food and Rural Affairs) and is a base for endurance horses owned by the Sheik’s family. It is unknown whether the seizure at Stansted and the raid at Moorley Farm are connected.",Banned equine drugs were found on a Dubai government private jet at Stansted airport. Sheik Mohammed has ordered an investigation into the seizure. He is the owner of the Godolphin stable. The UK Border Agency and Veterinary Medicines Directorate seized the unlicensed products.,727,0.469,43,0.93 +7,"By . Sam Webb and Amanda Williams . PUBLISHED: . 10:59 EST, 18 June 2013 . | . UPDATED: . 19:56 EST, 18 June 2013 . After suffering several soggy summers, it is not the news we were hoping for. Met Office experts who got together to discuss recent unusual weather patterns predicted yesterday that Britain faces a decade of wet summers. They blame natural warming in the Atlantic for pushing a current of fast-flowing air in the upper atmosphere, known as the jet stream, further south. People being rescued from the 2007 Summer floods in Tewkesbury, Gloucestershire. Britain could be subjected to wet summers for at least another decade, weather experts have today warned . Spectators make their way through the mud as they arrive for the British Grand Prix at Silverstone Circuit, last July. Six out of the last seven UK summers have seen above average rainfall . Six out of the last seven UK summers . have seen above average rainfall - with just 2010 the exception. It is . thought that long-term Atlantic currents could be playing an important . role. Weather and . climate experts from across the UK, who met at the Met . Office’s HQ in Exeter today to discuss the recent run of unusual seasons . in Europe, warned that as these operate on cycles of a decade or more, . we could experience sodden summers for 'years to come'. However, all is not lost as while these influence the odds of wet summers, it doesn’t rule out the possibility of bouts of sunshine and fine weather over the next few years  - starting with tomorrow, when Britain is expected to bask in its hottest day of the year. Temperatures will reach a high of 26C (78F) today before possibly hitting 30C (86F) tomorrow. But . high humidity means many areas could see rain and thunderstorms . tomorrow morning and evening and sunshine struggling to break through . the cloud. Experts from the Universities of Exeter, Leeds, Oxford, Reading and Imperial College London, as well as the Met Office, attended today's summit. Blue sky thinking: A jogger takes in the sight of Whitburn windmill, South Tyneside, as the weather heats up . Spray: As the hottest day of the year looms, Velvet is taken for a gallop through the sea by rider Dela Bute, 21, on Seaburn beach, Sunderland . Continental Europe basked in high temperatures, and that weather is set to sweep across the UK . They met to discuss weather patterns and . their potential causes in three recent seasons – the cold winter of . 2010/11, the wet summer of 2012, and this year’s cold spring. Professor Stephen Belcher, Head of the Met Office Hadley Centre and chair of the meeting, said: 'Ultimately what we’ve seen in each of these seasons is shifts in the position of the jet stream which impact our weather in certain ways at different times of year. 'The key question is what is causing the jet stream to shift in this way? There is some research to say some parts of the natural system load the dice to influence certain states of the jet stream, but this loading may be further amplified by climate change.' Brendan Jones, senior forecaster at MeteoGroup, the weather division of the Press Association, . said tomorrow's warm weather was being carried by warm air coming up from the . Continent, with Germany, France and the Low Countries seeing . temperatures soar past 30C (86F) in the past few days. 'It does look as if today and tomorrow are going to be very warm,' he said. 'I think today will be the hottest day of the year and tomorrow will break that again.' Temperatures should be high across England and Wales, with the South East seeing the highest temperatures, he said. Cyclists take advantage of the gorgeous weather to enjoy the daisy meadow at Souter Lighthouse near South Shields. The UK is set for a very warm and thundery plume of air from France which will set temperatures soaring across much of the country . Fields of gold: Twin four-year-old sisters, Florence (left) and Emma Hartley (centre) play with their friend Laura Stockwell (right) near Blithfield reservoir, Staffordshire . Blue skies covered the north east coast of England this morning. Brothers Jack (left), two, and four-year-old Oliver Hood from Durham enjoy the sunshine at Souter Lighthouse near South Shields . Because of the large amount of cloud, they are likely to hit a high of around 28C (82F) tomorrow, but any areas lucky enough to have sunshine all day may see temperatures hitting 29C (84F) or 30C (86F). Further north, temperatures will remain lower, and they will fall back to the low 20Cs from Thursday, Mr Jones said. The welcome warm blast follows what the Met Office said was the coldest spring since 1962, with a mean temperature across March, April and May of 6C (43F), 1.7C below the long-term average. Summer fun: Sharon Jamesieson (left), 20-month-old Nadia (centre) and Nadia Jamesieson, aged 16, from North Tyneside enjoy the sun on Tynemouth Beach . The sunrise over the Sean Henry sculpture 'Couple' and St Bartholomew's Church in Newbiggin-by-the-Sea, Northumberland, earlier today . Weather and climate experts from across the UK went to the Met Office’s HQ in Exeter today for a workshop to discuss the recent run of unusual seasons in Europe. A total of 25 delegates attended including representatives from the Universities of Exeter, Leeds, Oxford, Reading and Imperial College London, as well as the Met Office. Workshops of this kind are held on a regular basis on a great deal of issues across weather and climate science. Today’s included sessions which looked at the strange weather patterns and their potential causes in three recent seasons – the cold winter of 2010/11, the wet summer of 2012, and this year’s cold spring. Professor Stephen Belcher, head of the Met Office Hadley Centre and chair of the meeting, said: 'Ultimately what we’ve seen in each of these seasons is shifts in the position of the jet stream which impact our weather in certain ways at different times of year. 'The key question is what is causing the jet stream to shift in this way? 'There is some research to say some parts of the natural system load the dice to influence certain the jet stream, but this loading may be further amplified by climate change.' There are a number of possible factors which could be ‘loading the dice’, including declining Arctic sea ice, solar variability and long-term ocean cycles. The workshop focused on the latest research looking at how these drivers can influence weather patterns and discussed future research can be targeted to push forward understanding in this area. There are a wide range of factors that could be causing the cold winters such as changes in the Arctic climate. Dr James Screen, from the University of Exeter, said: 'There has been a lot of talk about declining Arctic sea ice playing a role in our weather patterns, but really that’s just one aspect of changes in the Arctic climate – which has seen rapid warming compared to other parts of the world. 'Those changes mean there is less of a difference in temperature between the Arctic and tropics, which could impact the position of the jet stream.' Another driver of colder winter weather has already been identified and is known as Sudden Stratospheric Warmings (SSWs). Recent research in this area has meant the Met Office was able to give good advice up to a month ahead on cold spells in recent seasons when they have been driven by this phenomenon. Professor Belcher said: 'This workshop has looked at some really cutting edge research and helped us identify key areas for future work to improve our understanding of potential drivers of some of the unusual seasons we have seen. 'This work will help us continue our work to push forward understanding in this area so we can give better forecasts and advice on longer timescales in the future.'Source: Met Office .",Met Office experts predict a decade of wet summers in Britain. They blame natural warming in the Atlantic for pushing a current of fast-flowing air in the upper atmosphere further south. Sam Webb and Amanda Williams are sceptical about the forecast.  ,1351,0.432,41,0.854 +8,"(CNN) -- When CNN highlighted some excellent historic restaurants in major cities across the country last month, readers wondered why their small-town and smaller-city favorites didn't make the cut. Thus, in this follow-up tribute to more laudable veteran restaurants, we've zeroed in -- thanks to suggestions from our commenters -- on the decades-old, and in certain cases centuries-old, icons that thrive outside of America's biggest metropolises. Columbia Restaurant, 1905 . The Hernandez/Gonzmart family claims the title of Florida's oldest restaurant and America's oldest Spanish restaurant with their 107-year-old icon Columbia in the Ybor City area of Tampa. What started as a corner cafe for the cigar workers in town has ballooned into a 1,700-seat restaurant specializing in Cuban and Spanish cuisine. Live jazz and flamenco shows are offered on most nights, and the gift shop comes complete with cigar rolling demonstrations in the afternoon. The restaurant expanded with locations across Florida -- including one in Tampa International Airport -- but the locals still stop in here for the famous Cuban sandwiches, the 1905 salad, tossed tableside and the old-school Spanish decor. 2117 East 7th Avenue, Tampa, Florida (813) 248-4961 . Louis' Lunch, 1895 . The supposed originator of the hamburger, Louis' Lunch in New Haven, Connecticut, has been serving beef patties on white toast since before buns were even invented. Legend has it that in 1900, a customer asked the restaurant's founder, Louis Lassen, for a quick meal he could eat on the run. He broiled some steak trimmings, put them between two slices of bread, and voila, the burger was born. Over a hundred years later the lunch wagon has evolved into a squat, Victorian-looking restaurant, featuring wooden chairs and carved graffiti-ridden tables and a menu offering just four items: burgers, potato chips, potato salad and pie. The patties are placed on vertical, antique 1898 cast iron grills that cook the burgers on both sides simultaneously to medium rare. And don't ask for ketchup. Only three condiments are offered: cheese spread, tomatoes and onions. 261-263 Crown Street, New Haven, Connecticut (203) 562-5507 . Samoa Cookhouse, 1893 . Back in the heyday of logging in the late 19th and early 20th centuries, companies set up cookhouses to feed their workers. These mess halls/community centers offered three hot meals a day (and cold meals on Sundays) for an affordable price, served family style. The Louisiana-Pacific Samoa Cookhouse in Samoa, California, began as one such kitchen in 1893 and continues the tradition of serving affordable, family-style meals in a no-frills setting. Current menu items include French toast, pancakes and sausage for breakfast, chicken parm and pot roast for lunch, and roast beef, short ribs and ham for dinner. Those with a strong sense of nostalgia should check out the restaurant's museum on the second level, which is filled with old photographs along with logging and maritime relics. 908 Vance Avenue, Samoa, California (707) 442-1659 . Smackdown: Tampa Bay area boasts sandy shores, surrealism . Brookville Hotel, 1870 . When the Brookville Hotel, the home of famous, affordable and hearty fried chicken dinners, was forced to move locations in 2000 due to a sewage issue, the owners decided to make an exact replica of their former home, one their loyal regulars would recognize. The new version, located 40 miles away from Brookville in Abilene, Kansas, includes a rebuilt facade and as many of the old doors and fixtures from the original hotel restaurant, with origins dating back to 1870, as possible. Brookville Hotel stopped welcoming overnight guests decades ago, but the name lives on. The chicken dinner, served since the current owners' great-grandmother originated it in 1915, includes coleslaw, half a fried chicken, mashed potatoes, creamed corn, biscuits and ice cream, all for $15. 105 E. Lafayette, Abilene, Kansas (785) 263-2244 . Shady Glen, 1948 . Manchester, Connecticut, institution Shady Glen began back in 1948 as a classic soda fountain and ice cream maker, the offshoot of a dairy farm. When the original owners, John and Bernice Rieg, decided to branch out to lure business in the colder months, they added savory diner staples to their menu -- including a special take on the classic griddle-top cheeseburger featuring a giant crown (using four slices) of crispy cheese. Burgers and homemade ice cream are still served in the old diner today, which was enlarged and renovated over the decades but has kept the same look since 1978. 840 Middle Turnpike E, Manchester, Connecticut (860) 649-4245 . Cold Springs Tavern, 1886 . Cold Springs Tavern, founded in 1886 on a site established as a stagecoach stop in the 1860s, is located 20 minutes north of Santa Barbara, California, nestled on a mountainside off a winding road. Its buildings, a group of low log cabins outfitted with fireplaces, taxidermy and animal hides, have been preserved through the decades, making this a local destination, even without much signage or promotion. The place is big with bikers, especially on Sundays when live music is offered and the Log Cabin Bar offers their locally famous tri-tip steak sandwiches. 5995 Stagecoach Rd., Santa Barbara, California (805) 967-0066 . Race for the next presidential birthplace . Red Fox Inn and Tavern, 1728 . Those looking for an old Colonial experience should seek out the Red Fox Inn and Tavern, right in the middle of Northern Virginia's hunt country. Founded in 1728, the inn housed presidents and Revolutionary War heroes, was a medical center for the Confederate Army during the Civil War, and has attracted famed guests like Jackie Onassis and Elizabeth Taylor. The tavern looks as it might have in the 18th century, with thick stone walls, large fireplaces, beamed low ceilings and long oak tables. The menu changes seasonally but features old Southern classics like fried chicken, crab cakes and peanut soup. 2 East Washington Street, Middleburg, Virginia (540) 687-6301 . Al's Restaurant, 1925 . A guide to old-school American restaurants wouldn't be complete without a grand steakhouse, and Al's Restaurant, a St. Louis fixture since 1925, fits the bill. Stepping inside the restaurant, located in an unassuming building by the city's waterfront, is like entering a time warp. Though Al's began as an outpost selling egg sandwiches to the dock workers nearby, the founders' son transformed it into a fine-dining chop house with white tablecloths, wood paneled walls and a verbal menu -- servers come around with raw cuts of meat and fish to choose from -- of chops, steaks and seafood. It's not cheap by any stretch, but Al's is a staple in the area and is run by the grandchildren and great-grandchildren of the original immigrant founders. 1200 North 1st St., St. Louis, Missouri (314) 421-6399 . Chef Vola's, 1921 . Up until the 1980s, when the current owners bought it, Chef Vola's had no phone number, no signage and survived for 60 years in the basement of an Atlantic City row house strictly by word of mouth. Though it's a little easier to access now, reservations are still tough to come by, with good reason. The setting is unique in that it feels like someone's home -- until recently diners had to walk through the dishwashing area to get to the bathroom -- and the vibe is that of a large family gathering. And then there's the food: fettuccine in clam sauce, a primal-sized veal parmigiana on the bone, steak charred ""Pittsburgh style,"" famed banana cream and caramel ricotta pies, and dozens of others delectables. Try calling the day of to see if there are any cancellations, and note it's BYOB and cash only. 111 S. Albion Pl., Atlantic City, New Jersey (609) 345-2022 . Oktoberfest closer to home: Five U.S. festivals . The Bright Star, 1907 . A large contingent of customers have been coming to The Bright Star, a 105-year-old casual Greek/Southern restaurant in downtown Bessemer, Alabama, for decades. A large contingent of the restaurant's workers have been there even longer. And its owners, Nicky and Jimmy Koikos, one of whom is there almost every shift, have been keeping the family tradition alive since 1966. Why all the dedication? First there's the fresh seafood, trucked in from the Gulf Coast daily and served with a Greek flair. But also, it serves as a community gathering place and hub for Bessemer locals, growing from a 25-seat cafe to a 330-seat restaurant over the decades. Specialties include the seafood gumbo, the Greek snapper and the lemon ice box pie. 304 19th St. North, Bessemer, Alabama (205) 424-9444 . Where have you had a favorite meal that stands out and brings back fond memories? (It doesn't have to be fancy. ) Please share in the comments below.","Last month, CNN highlighted some excellent historic restaurants in major cities across the country. This time, we focus on the decades-old and in some cases centuries-old icons that thrive outside of America's biggest metropolises. Columbia Restaurant, 1905 is one of them.",1440,0.578,41,0.902 +9,"(CNN) -- Japanese golf prodigy Ryo Ishikawa has announced he will donate his tournament earnings from 2011 to the victims of the tsunami which recently devastated the Asian country. Ishikawa, 19, will also give $1,200 for every birdie he achieves during the year and the world number 45 is planning a tour of the severely effected Tohuku area of Honshu Island. ""I feel thrilled. My goal is 200 million yen [$2.4 million],"" Ishikawa is reported as saying by news agency AFP. The Saitama-born star turned professional in 2008 and has earned in excess of $1.2 million during each of his three years in the sport, according to AFP. Ishikawa broke a world record in May 2010 when he shot the lowest-ever score in a major golf tournament with a 12-under par 58. ""I have enough money to spend for my golf. I still have savings. I believe this is the most positive way for me to spend money,"" he added. The nine-time winner in Japan finished third on the country's money list in 2010 and sought the advice of his father, who is a banker, before making the decision. Ishikawa is currently in the U.S. preparing for The Masters at Augusta in Georgia, which is due to start on April 7. The earthquake and tsunami which ravaged Japan is estimated to have claimed 18,000 lives and prompted a nuclear crisis at the stricken Fukushima plant.","Ryo Ishikawa will donate his tournament earnings from 2011 to the victims of the tsunami in Japan. Ishikawa, 19, will also give $1,200 for every birdie he achieves during the year. The world number 45 is planning a tour of the severely affected Tohuku area of Honshu Island.",235,0.651,48,0.875 +10,"Warsaw (CNN) -- Eleven people died and one, somehow, survived when a small aircraft belonging to a private parachute school crashed Saturday in Poland, state news reported. Firefighters learned about the crash near Czestochowa, a city some 140 kilometers (85 miles) north of Krakow, around 4:20 p.m., Polish Press Agency (PAP) reported. Czestochowa fire Capt. Pawel Liszaj told PAP that arriving firefighters found three people outside the aircraft, one of whom was still alive. ""Unfortunately, everything indicates that he is the only person who survived the crash,"" provincial police spokeswoman Joanna Lazar told CNN affiliate TVN. Authorities later discovered nine bodies inside the plane's wreckage, according to Liszaj. The survivor -- who was one of the three initially spotted outside the aircraft -- was flown by helicopter to a Czestochowa hospital, Robert Galazkowski, the head of the Polish Medical Air Rescue, told PAP. The 40-year-old man was conscious from the time he was found, though he suffered many injuries, including to his pelvis, according to the report. He was in serious but stable condition Saturday evening, Galazkowski said. The cause of the crash wasn't immediately known. CNN's Greg Botelho contributed to this report.","Eleven people died and one survived when a small aircraft belonging to a private parachute school crashed near Czestochowa, about 85 miles north of Krakow. Firefighters found three people outside the aircraft, one of whom was still alive, a fire official says.",193,0.731,42,0.881 +11,"By . Associated Press . PUBLISHED: . 09:08 EST, 26 June 2012 . | . UPDATED: . 12:17 EST, 26 June 2012 . From a chapel pulpit on Lackland Air Force Base, where every American airman reports for basic training, Col. Glenn Palmer delivered his first order to nearly 600 recruits seated in the pews: If you're sexually harassed or assaulted, tell someone. 'My job is to give you a safe, effective training environment,' Palmer said firmly. What the colonel did not mention directly in his recent address was a widening sex scandal that has rocked the base, one of the nation's busiest military training centers. Victims?: Female airmen march during graduation at Lackland Air Force Base in San Antonio . Allegations that male instructors had sex with, and in one case raped, female trainees have led to criminal charges against four men. Charges against others are possible. The most serious accusations surround an Air Force staff sergeant scheduled to face a court-martial in July on charges that include rape and multiple counts of aggravated sexual assault. The other three defendants were charged with lesser crimes ranging from sexual misconduct to adultery. All of the defendants were assigned to turn raw recruits into airmen in eight weeks of basic training. A two-star general is now investigating alongside a separate criminal probe, which military prosecutors say could sweep up more airmen. Advocates for female service members and members of Congress have started taking notice. 'It's a pretty big scandal the Air Force is having to deal with at this point,' said Greg Jacob, a former Marine infantry officer and policy director of the Service Women's Action Network. 'It's pretty substantial in its scope.' Col. Glenn Palmer (pictured) advised recruits: If you're sexually harassed or assaulted, tell someone but did not mention the scandal . Yet there are signs the Air Force still doesn't have a handle on the full depth of the problem. Staff Sgt. Peter Vega-Maldonado pleaded guilty earlier this month to having sex with a female trainee and struck a plea deal for 90 days' confinement. Then he acknowledged being involved with a total of 10 trainees — a number previously unknown to investigators. On Friday, after months of embarrassing disclosures, the head of the Air Force's training command ordered Maj. Gen. Margaret H. Woodward to lead an independent investigation. That same day, the Air Force gave reporters rare access to Lackland's instructional headquarters in an effort to show there was nothing to hide. The headquarters facility is where Lackland trains the people who train recruits. Inside one small classroom, three women and two men were lectured on the importance of having a moral compass while watching a slide presentation titled 'Integrity First'. Lackland has about 475 instructors for the nearly 36,000 airmen who will graduate this year. That's about 85 per cent of what Lackland would consider a full roster of instructors, a demanding job that requires airmen to work longer hours than most for four years, at the expense of family and personal time. The Air Force recently launched a smartphone app to help recruit instructors. Topping a page of frequently asked questions is whether the divorce rate for instructors really is higher. (The Air Force says no.) Palmer said that a slight shortage in instructors has not lowered the standards for applicants. In response to the allegations, he said instructor training is being revamped and that he was accountable for problems within the training wing. Leaders of the instructor program, however, said the responsibility falls on the accused. 'A person sitting in that seat, they're going to do what they're going to do when no one is watching,' said Master Sgt. Greg Pendleton, who oversees the training. 'That's across the board. That's just them. When we're outside this door or outside these walls, there are individuals that have their own personal values.' Military personnel stand outside the Lackland Air Force Base in Texas, one of the nation's busiest military training centers, where four male instructors are charged with having sex with, and in one case raping, female trainees . So widespread is the fallout that Lackland halted operations for an entire day in March to survey about 5,900 trainees about whether they had seen or been a victim of sexual misconduct. It was a highly unusual move for a vast 15-square-mile base that runs with relentless efficiency. A new class of airmen graduates every Friday for 50 of the 52 weeks in the year. At first, Palmer, commander of the 737th training wing, said he wasn't sure that halting training was even possible. Airman Andrea Madison, a new graduate who was in basic training at the height of the investigation at Lackland, said she never felt uncomfortable with her instructors. 'They want to make sure no foul play is happening, no one is taking advantage of us,' said Madison, of Columbus, Ohio. Last week, one commander of a Lackland training squadron caught up in the sex scandal was dismissed after the Air Force lost confidence in his leadership. Col. Polly Kenny, 2nd Air Force Staff, said the dismissal was not directly related to the sexual misconduct investigation. The Service Women's Action Network supports and works with servicewomen . Nearly three dozen instructors at Lackland have also been removed in the past year, but the Air Force will not say how many lost their jobs as a result of the investigation that began last fall, only that the majority of dismissals were unrelated. The first sexual misconduct allegations at Lackland surfaced a year ago against Staff Sgt. Luis Walker, who is charged with 28 counts. Walker, the only instructor who has been accused of sexually assaulting another airman, faces life in prison if convicted. His civilian attorney, Joseph Esparza, has declined to speak with reporters and did not return multiple calls for comment. Sexual assault victims are reassigned and can apply for a 'humanitarian discharge' from the military, but Lackland civilian spokeswoman Collen McGhee said she did not know whether those affected by this case had done so.","Col. Glenn Palmer delivered his first order to nearly 600 recruits seated in the pews at Lackland Air Force Base: If you're sexually harassed or assaulted, tell someone. He didn't mention a widener directly in his recent address, but he did mention that his job is to give them a safe, effective training environment.",1011,0.533,54,0.889 +12,"By . Adam Shergold . PUBLISHED: . 13:08 EST, 5 February 2014 . | . UPDATED: . 13:32 EST, 5 February 2014 . England wicketkeeper Matt Prior has hit back at claims by TV personality Piers Morgan that he launched a dressing room tirade at Andy Flower during the team's disastrous tour of Australia. Morgan claimed on Twitter that Prior, who was dropped after the third Test in Perth, told the England team after the fourth Test in Melbourne that coach Flower was 'behaving like a headmaster' and they were playing in a 'schoolboy environment.' The storm comes 24 hours after England selectors sacked batsman Kevin Pietersen in the wake of England’s 5-0 Ashes defeat Down Under. VIDEO: Scroll down to see Piers Morgan trying to get out of the way a Brett Lee over . Hitting out: Matt Prior has blasted accusations from Kevin Pietersen's friend Piers Morgan . Tough time: Prior struggled in Australia and was dropped after the third Test . Morgan tweeted on Wednesday afternoon: . 'I'm about to tweet what @MattPrior13 told England players in team . meeting after Melbourne Test. ''Flower's . behaving like a headmaster, this is a schoolboy environment. F**k . Flower! This is OUR team!' - @MattPrior13 to England team.' Morgan went on to claim Prior was a 'hypocrite' and challenged him to take legal action if his accusations were incorrect. He . added: 'You stabbed @KP24 [Pietersen] in the back @MattPrior13 - yet . you agreed with him re Flower's dictator style. Makes you a flaming . hypocrite.' 'For the record, @MattPrior13 led the England team meeting after Melbourne Test. And slaughtered Flower. Happier times: Pietersen (left) and Prior celebrate Ashes victory Down Under in 2010 . 'If you didn't say it @MattPrior13 - then sue me. That should clear things up.' But Prior took to Twitter shortly afterwards to defend himself against Morgan's claims. He . wrote: 'I don't do this PR, spinning media rubbish but I refuse to be . attacked by a bloke that knows very little about what goes on in the . England setup apart from rumour, gossip and hearsay from certain . individuals (most of whom I'd take with a pinch of salt). 'Maybe . I was recorded or 'hacked' but if not I'd like to see where these words . I apparently said have come from? I'm not the kind of person to divelge . [sic] what is said in team meetings but all I will say is that Flower, . [Alastair] Cook and the rest of my team mates know exactly what I said . & the way in which it was meant! Re-integrated: Prior posted this picture of Pietersen on Twitter in late 2012 with the caption: '""Re-integration complete. Well played"".' 'There . is no story here just an attempt to knock someone who has only ever had . the teams best interests at heart and tried my best on and off the . field to help the England cricket team. 'I can hold my head up high in that knowledge! #endof' He . then retweeted a message that pointed out Prior was one of the England . team who defended Pietersen during the 'text-gate' scandal, in which the . batsman sent text messages to members of the opposition . dressing room during South Africa's tour of England in 2012. However, in response, Morgan tweeted that Prior 'was actually one of the worst re KP' and Prior 'stabbed KP right in the back.' Taking a battering: Piers Morgan (right) faces Brett Lee in the nets at the MCG .",Matt Prior has hit back at Piers Morgan's claims that he launched a dressing room tirade at Andy Flower during the team's disastrous tour of Australia. Morgan claimed on Twitter that Prior told the England team after the fourth Test in Melbourne that Flower was behaving like a headmaster and they were playing badly.,598,0.548,54,0.852 +13,"Once an annual round of exclusive balls, refined dinner parties and other polished social events, the London season – the highlight of which was the debutante ball- was an important way for the elite to match make the younger generations. Today however, not only has the ball has lost its royal patronage, but is barely recognisable from its aristocratic origins. Held this year in Highclere Castle, which plays host to popular ITV drama Downton Abbey, the ball is increasingly popular among affluent foreigners and mega-rich Britons looking to experience a piece of Britain's cultured past while simultaneously putting their wealth on display. Scroll down for video . Debutantes pose for a photograph before the start of the Queen Charlotte's Ball which was held last night at Highclere Castle . The young ladies rehearse their curtsy prior to the ball which marks the end of a year of charity fund raising and etiquette classes for the debutantes . This year the excited debutantes also had the opportunity to play at being the Lady Grantham as they spent hours preening in the now famous Downton castle . Each ticket to the ball cost thousands, with a table costing £2,500, meaning nearly all of the debutantes hail from ultra-rich families . Most young ladies take the opportunity to have a bespoke designer dress made for the night . In the past, young women from the very best landed gentry stock would be presented to the monarch at Buckingham Palace in a virginal white gown at the Queen Charlotte's Debutante Ball to announce their ‘coming out’ into society. No longer an event for an elite group of the British aristocracy, the Queen Charlotte's Debutante Ball, this year held at Highclere Castle, near Newbury, is now open essentially to anyone who can afford it. This year the excited debutantes also had the opportunity to play at being the Lady Grantham as they spent hours preening in the now famous castle before their sweeping entrance into the ball. The historical ball is steeped in traditions, but many claim is barely recognisable from its aristocratic origins . Each debutante will have been selected – and paid thousands of pounds- for the privilege of taking months of etiquette classes and dabbling in carefully chosen charity projects . The ladies being ‘presented’ are still a rather spectacular vision in a sea of cream silks, chiffon and lace . Debutantes prepare to take their places for a meal during the Queen Charlotte's Ball at Highclere Castle . With tables starting at £2,500 and run by a partnership of corporate sponsors and companies based in the United Arab Emirates, attendance is strictly for the well-to-do, with many traditionalists bemoaning the loss of the balls gentile and refined roots. And while the young ladies being ‘presented’ are still a rather spectacular vision in a sea of cream silks and lace, their place at the Ball will have been purchased, rather than a birth right. Apparently celebrating their year of charity fund raising, etiquette classes and ‘debut’ on the dating scene at The Queen Charlotte's Ball, most young ladies take the opportunity to have a bespoke designer dress made for the night. Each will have been selected – and paid thousands of pounds- for the privilege of taking months of etiquette classes and dabbling in carefully chosen charity projects. Debutante Elizabeth Muncey applies lipstick in her dressing room before the start of the ball . During the ball the debutantes are presented to guests and curtsy to the Queen Charlotte Cake (pictured) After the ceremony the ladies are allowed to change into a dress of their choosing for the after party- with most years leading to tales of debauchery . The young ladies, usually aged between 17 and 20 then finish their debutante experience by attending the grand ball where they are presented to guests and curtsey to the Queen Charlotte Cake. Prior to the event older debutantes are on hand to guide and critique the girls on their dress, dancing and pace around the ballroom and on the day an army of professional hair and make-up artists are on hand to make sure that the girls are glowing, setting off perfectly coiffed up 'dos with diamond studded tiaras and precious jewellery. The 'deb of the year' is chosen according to 'who has worked hardest’ during fund-raising activities throughout the season and shown the most enthusiasm. On the day an army of professional hair and make-up artists are on hand to make sure that the girls are glowing, . The young ladies, usually aged between 17 and 20, try on their couture gowns before the start of the ball . The grand ball room at Highclere castle was the venue for the after dinner dancing at this years ball . The Queen’s sister, Princess Margaret famously said of the end of the royal patronage of the ball: ‘we had to put a stop to it . . . every tart in London was getting in!’ After the ceremony the ladies are allowed to change into a dress of their choosing for the after party- with most years leading to tales of debauchery and behaviour most unfitting for a lady. The ball has been running almost every year since 1780, when King George III first organised the Queen Charlotte’s Ball as a way to celebrate his wife’s birthday. The ceremony remained unchanged- with debutantes paying respects to a large iced cake at Buckingham Palace, overseen by the monarch- until 1958, when Prince Philip persuaded the Queen to stop receiving each year’s crop at Court. Philip is said to have complained that the annual Ball, at which girls aged 17 and 18 were expected to meet their suitably-moneyed future husbands, was ‘bloody daft’. The Queen’s sister, Princess Margaret, was even more forthright, saying later ‘we had to put a stop to it . . . every tart in London was getting in!’ Since 1958 the ball was held sporadically at various exclusive venues in the capital to varying degrees of success before being relaunched in 2009 and held annually since, albeit without its royal seal of approval.","The debutante ball has lost its royal patronage and is barely recognisable from its aristocratic origins. This year's ball was held in Highclere Castle, which plays host to popular ITV drama Downton Abbey. It is increasingly popular among affluent foreigners.",1022,0.43,40,0.9 +14,"(CNN) -- The memory unit that may tell why an Air France jet plunged into the Atlantic nearly two years ago was recovered from the bottom of the ocean Sunday, France's Bureau of Investigation and Analysis (BEA) said. A remote-controlled submarine, known as the Remora 6000, located the memory unit Sunday morning and it was lifted on board the search ship Ile de Sein six hours later, the Paris-based BEA said. All 228 people aboard the Air France Flight 447 were killed when the plane fell into the ocean on the way from Rio de Janeiro to Paris on June 1, 2009. The submarine found the orange-colored flight data recorder's chassis Wednesday, the second day of an operation that also hopes to retrieve bodies from the wreckage site. The memory unit was part of the recorder, but was not attached when it was found. The flight recorder chassis is found last week . The finds come more than three weeks after search teams found the tail section of the Airbus A330. Air France, in a written statement Sunday, called the discovery ""very significant."" ""We hope that the BEA, in charge of the technical investigation, will be able to provide answers to questions that relatives of the victims, Air France and the entire airline industry have been asking for nearly two years as to why this tragic accident occurred,"" the airline's statement said. A British aviation consultant said he is skeptical about how useful the memory unit will be to investigators, considering it has been sitting between 2,000 to 4,000 meters (6,562 to 13,124 feet) below the ocean's surface for 23 months. ""If you were to throw a computer into the ocean, imagine how all the parts would eventually split and you have the corrosive effects of seawater and the depths involved,"" Phil Seymour, chief operating officer of the International Bureau of Aviation, said Thursday. Father of crash victim: Leave remains . ""It may be that the more wreckage they find will help them to piece it all together, which bit by bit could help them build a picture of what caused the plane to come down,"" Seymour said. Martine Del Bono, a spokeswoman for the Paris-based BEA, says there is a good chance the memory unit, which records any instructions sent to the aircraft's electronic systems, will still hold retrievable data. The Airbus A330's pilots lost contact with air traffic controllers while flying across an area of the Atlantic Ocean known for constant bands of severe turbulence, officials said. Q&A: Will mystery ever be solved? But exactly what caused the plane to plunge into the sea has remained a mystery, with only small portions of the wreckage and a handful of bodies found in the remote area where it went down. CNN's Ayesha Durgahee contributed to this report.",The memory unit that may tell why an Air France jet plunged into the Atlantic nearly two years ago was recovered from the bottom of the ocean Sunday. All 228 people aboard the Air France Flight 447 were killed when the plane fell into the ocean on the Atlantic seabed.,468,0.611,50,0.78 +15,"By . James Nye . Under mounting pressure to speak out about the controversy that has engulfed the department store this week, the rap mogul released a lengthy statement on his website after an online petition called for him to bow out of his upcoming partnership with Barneys. The Manhattan superstore stands accused of profiling two young black people, calling the police on both after they purchased expensive items. The rapper has signed a contract to design an exclusive line for Barneys that will be available next month. But Jay-Z - whose real name is Shawn Carter - defended himself, saying that he hasn't spoken about it because he's still trying to figure out exactly what happened. 'I move and speak based on facts and not emotion,' the statement said. Scroll Down for Video . Speaking out: Jay-Z has faced claims of supporting Barneys in the wake of their racial profiling scandal. The rapper says he is waiting to receive all the proper information before commenting or taking action, and that he has been demonized for doing so . Defending himself: Jay-Z reacts to increasing pressure in a statement on his website . 'I haven't made any comments because I am waiting on facts and the outcome of a meeting between community leaders and Barneys. 'Why am I being demonized, denounced and thrown on the cover of a newspaper for not speaking immediately?' 'I am not making a dime from this collection ... I need to make that fact crystal clear. The Shawn Carter Foundation is the beneficiary ... This money is going to help individuals facing socio-economic hardships to help further their education at institutions of higher learning. 'I am against discrimination of any kind, but if I make snap judgements, no matter who it’s towards, aren’t I committing the same sin as someone who profiles? 'I am no stranger to being profiled and I truly empathize with anyone that has been put in that position.' The statement came after residents of Marcy House, in Brooklyn, where Jay-Z grew up, called on the '99 Problems' rapper and husband of Beyonce to think about those who have not become as succesful as him.'Jay Z and my son grew up together,' said Effie Hardy, 74, to the New York Daily News. 'That could be his family Barneys is profiling. They would’ve done the same thing to him back in the day, before he got to where he is now. He should remember that.' The luxury and exclusive collection that Jay-Z has lent his considerable clout to is named 'A New York Holiday,' and the cheapest item is a $70 cotton T-shirt, while a Shawn Carter watch by Hublot with alligator skin straps will cost $33,900. Expensive: Items available from Jay-Z's new exclusive line at Barneys called 'A New York Holiday' - which has products available for tens of thousands of dollars . Another Marcy resident, Annette Rush, 40, told the New York Daily News that as a role model, Jay-Z should think about the ramifications of the two shoppers allegations. 'My money is as good as anybody else’s money. It’s all green,' said Rush. 'From someone that came from the hood, he should know all that. He knows how hard it is. I don’t think he should sell his things there, not at a place where there’s racial profiling going on. It’s ridiculous.' The controversy began when two black customers came forward to say that they had been stopped and detained after buying expensive items from the luxury store. Anger: Social media vented its dismay towards Jay-Z and one user attempted to link the Trayvon Martin case and the profiling of two customers at Barneys . Evocative: This Twitter user tries to invoke Jay-Z's paternal instincts by questioning how he would feel if his daughter was racially profiled as it is alleged the NYPD and Barneys profiled two black customers . On Tuesday, Trayon Christian, 19, from Queens said that he was suing the city and Barneys after he was accosted by two undercover NYPD detectives after he had bought a $349 Ferragamo belt. And then on Wednesday, Kayla Phillips, 21, a seven-month pregnant mother from Canarsie, Brooklyn, said that she too had been stopped. The young mother, from Brooklyn, New York, said she experienced similarly shocking treatment from staff at the Madison Avenue store in February when she bought a $2,500 Céline handbag. She has now filed a $5 million notice of claim with the city showing her intention to sue the NYPD. 'As I was walking into the train station, four undercover police officers attacked me,' Phillips told the New York Post. 'They were very rough,' she added to the New York Daily News. 'I didn't know what was happening.' She explained to the cops that she had used a temporary Bank of America card to make the purchase - and they demanded to know why her name was not on it. Complaint: Kayla Phillips, 21, says cops demanded to know how she could afford to buy a $2,500 Céline bag from Barneys in New York - in a case that echoes that of a teen accusing the store of racial profiling . Shock: She called her mother Wendy Straker (right with Kayla) who said she heard police ask her daughter: 'What are you doing here in Manhattan? Where'd you get the money to buy that expensive bag?' She called her mother, Wendy Straker, who said that the police officers had asked her daughter: 'What are you doing here in Manhattan? Where'd you get the money to buy that expensive bag?' Straker added that the police were on the phone with a Barneys employee about the transaction. Police finally let her go after she showed them her ID and new debit card, which arrived that morning. 'Jay Z is getting ready to do a campaign with Barneys, but they’re looking at these African-American kids like they're thieves,' Straker said. The case comes after it emerged that another shopper, Trayon Christian, was stopped and handcuffed after he bought a $350 Salvatore Ferragamo belt in the store. Treat: She had just bought a $2,500 orange suede Céline handbag when she was stopped by cops . Christian, 19, has now filed a lawsuit for unspecified damages against the Madison Avenue store and the NYPD who wrongly accused him of fraud. Mr Christian, who lives with his mom in Queens, had decided to splash out on the belt after seeing one of his favorite music stars, Harlem rapper Juelz Santana, wearing the accessory. However once he had paid for the belt and had left Barneys on April 29 this year, the fashion-loving teen was grabbed by undercover officers on the street. According to the civil rights lawsuit, the 19-year-old was asked 'how a young black man such as himself could afford to purchase such an expensive belt'. Mr Christian's lawyer Michael Palillo told the New York Daily News: 'He's never been arrested. His only crime was being a young black guy buying a $300 belt.' Trayon Christian, 19, has brought a lawsuit against Barneys and the NYPD after they wrongly accused him of fraud when he purchased a designer belt . Barneys department store is facing a lawsuit after a 19-year-old black student claims he was wrongly grabbed by store detectives because of his color and accused of stealing a designer belt . A Barneys store employee had asked the 19-year-old for ID when he used his Chase debit card to buy the belt. Mr Christian showed the clerk his state ID. Harlem rapper Juelz Santana (pictured right) wearing the belt coveted by his teenage fan . The store cashier then subsequently called the police to claim that the purchase was a fraud, according to the lawsuit. Officers took the teenager to a local precinct. Mr Christian once again showed his ID, debit card and receipt for the belt. Officers still refused to believe the teenager. Finally Chase bank was contacted who verified that the debit card belonged to Mr Christian. It was only then that he was allowed to go after spending two hours in a holding cell, the suit claims. The NYPD denied this and said the student was only held for 42 minutes. The student, who has no history of arrests, said that he will never shop at Barneys again following the incident. A Barney's New York spokesman said: 'Barneys New York typically does not comment on pending litigation. 'In this instance, we feel compelled to note that after carefully reviewing the incident of last April, it is clear that no employee of Barneys New York was involved in the pursuit of any action with the individual other than the sale. 'Barneys New York has zero tolerance for any form of discrimination and we stand by our long history in support of all human rights.'",James Nye has released a statement on his website about the controversy surrounding his upcoming partnership with Barneys. The department store is accused of profiling two young black people and calling the police on them after they bought expensive items. The rapper has signed a contract to design an exclusive line for Barneys that will be available.,1475,0.445,57,0.895 +16,"Police should face time limits on how long a person can languish on bail without being charged, the Home Secretary will say today. Theresa May is demanding action amid mounting anger that police forces are abusing their powers by keeping people in a legal limbo for ‘months or even years’ – only to be told they would not face any action. The issue has been highlighted by a number of high-profile cases, including celebrities and journalists, who have been left on bail for long periods – often with strict curbs to their freedom – without charges being pressed. Theresa May is demanding action amid mounting anger that police forces are abusing their powers by keeping people in a legal limbo for ‘months or even years’ Last week, the veteran disc jockey Paul Gambaccini, arrested in October last year by officers from Operation Yewtree, the inquiry launched in the wake of the late Sir Jimmy Savile being unmasked as a prolific paedophile, was informed he would not face sexual assault charges. The DJ, who was investigated over historic allegations of molesting two teenage boys, told of his ‘12 months of horror and trauma’ having his name dragged through the mud. The College of Policing, the professional body that sets police standards, has expressed concern over suspects being repeatedly re-bailed as it appears to be being used as a ‘quasi-judicial punishment’. Last week, veteran disc jockey Paul Gambaccini (left), arrested in October last year by officers from Operation Yewtree, the inquiry launched in the wake of the late Sir Jimmy Savile (right) being unmasked as a paedophile . The organisation has just concluded a review into how police and other law enforcement agencies use pre-charge bail in criminal investigations. But in a speech to the College’s annual conference in Coventry, Mrs May will order it to consult on introducing time limits on how long a person can spend on bail. Acknowledging it was a ‘sensitive area’, she said: ‘We must also look at statutory time limits on the use of pre-charge bail to prevent people spending months or even years on bail only for no charges to be brought.’ Mrs May declined to propose a possible time limit, but human rights group Liberty and the Law Society have suggested 28 days. Police are allowed 24 hours to keep a suspect for questioning after arrest before seeking a further period of detention from a judge. In practice, they often quiz a person then release them on pre-charge bail to return for further interview at a later date, giving officers time to build robust cases. But there are currently no restrictions on the length of time a person can spend on police bail which can force innocent people to put their lives on hold, pay thousands in legal fees and suffer the slow assassination of their characters. Conditions can also be placed on police bail, which can include curfews and restrictions on movement and financial transactions while an investigation continues. Comedian Jim Davidson (left) lashed out at the system after being kept on bail for eight months before being told he would not face any charges. Freddie Starr (right), another comedian, spent 19 months on bail after being arrested by officers investigating decades-old sex allegations made by 14 women . Comedian Jim Davidson lashed out at the system after being arrested under the Operation Yewtree and kept on bail for eight months before being told he would not face any charges. Freddie Starr, another comedian, spent 19 months on bail after being arrested by police investigating decades-old sex allegations made by 14 women. The case was dropped. Conservative MP Nigel Evans – who resigned as House of Commons deputy speaker before being cleared of sex assault charges in court in April – described the ‘indescribable torment, torture and stress’ of being left hanging on bail. He was eventually acquitted by a court of all charges of sexually assaulting Parliamentary researchers. Some 30 journalists are currently on bail – some for more than a year – while police investigate alleged crimes including phone hacking and paying public officials for stories. A Freedom of Information request in May last year found more than 57,000 people were on police bail at the time with more than 3,000 bailed for more than six months. Lord Macdonald, the former Director of Public Prosecutions, said recently: ‘There is sometimes a lack of urgency in police bail cases that is very worrying. Lives are put on hold and grave reputational damage goes unchecked, sometimes for years.’ Keith Vaz, the Labour chairman of the Home Affairs Select Committee, raised the issue during an evidence session with Alison Saunders, the Director of Public Prosecutions. Referring to the 30 journalists on bail who do or did work for The Sun or now-defunct News of the World, he said: ‘They have been bailed and rebailed without being charged and have had their careers ruined because they have been suspended or lost their jobs. ‘It can’t be right that these people keep getting bailed and re-bailed.’ Sorry we are not currently accepting comments on this article.","Theresa May is demanding action against police forces who keep people in legal limbo for 'months or even years' without being charged. The issue has been highlighted by a number of high-profile cases, including celebrities and journalists who have been left on bail for long periods.",850,0.486,46,0.935 +17,"Two Second World War Lancaster bombers flew together in the skies over Britain yesterday for the first time in 50 years. The world's only two airworthy Lancaster bombers were united on a windswept Lincolnshire airfield for what will probably be one of the last times. The Lancaster Thumper, which is part of the RAF Battle of Britain Memorial flight, joined the Canadian Lancaster Vera from a museum in Ontario. Scroll down for video . Off they go: This Ministry of Defence photograph shows spectators watching as two Lancaster Bombers prepare to fly in Coningsby, Lincolnshire . Together: The Lancaster Thumper, which is part of the RAF Battle of Britain Memorial Flight has been joined by the Canadian Lancaster Vera from Ontario . The two aircraft - pictured at RAF Coningsby - are expected to visit some 60 air shows and public events across the UK over the next five weeks. The planes had been due to pass over Lincoln Cathedral last Friday, but poor weather caused the flight to be postponed. MailOnline reported last Saturday on . how Vera had arrived in Lincolnshire following an epic 3,700-mile . journey to Britain from her base in Canada. Aircraft enthusiast Matthew Munson, . from Henley-on-Thames, Oxfordshire, bid £43,000 on eBay for the . privilege of flying in the bomber. Up in the air: The two aircraft are expected to visit some 60 air shows and public events across the UK over the next five weeks . On the tarmac: The world's only two airworthy Lancaster bombers were united on a windswept RAF Coningsby for what will probably be the last time . Leon Evans, chief pilot for the . Canadian Lancaster’s historic trip, said: ‘We haven’t had two Lancasters . fly together in a display before. ‘It’s pretty unlikely it’ll happen . again because these airplanes might run out of airtime. Vera’s getting . older and already has about 4,500 hours on her.’ Vera’s journey from Canada took four . days, involving stops in Newfoundland, Greenland and Iceland before she . arrived in Lincolnshire on Friday. More than 7,377 Lancasters, 430 of . which were built in Canada, were made during the Second World War but . many that survived were scrapped. 14-17 August - 'Airbourne' International Air Show - www.visiteastbourne.com/airbourne - Eastbourne, East SussexSaturday 16 August - Flying Proms - www.shuttleworth.org/tickets/event-details.asp?ID=268 - Old Warden, BedfordshireSaturday 16 and Sunday 17 August - Combined Ops 2014 - www.headcornevents.co.uk/event_ticket.php - Headcorn Aerodrome, KentSunday 17 August - Bay Day Air Display - http://baypromoteam.co.uk/bay-day-air-display-sun-17th-august/ - Herne Bay, KentSunday 17 August -Sywell Airshow - http://sywellairshow.co.uk/ - Sywell, NorthamptonshireThursday 21 August - RAF Marham Families Day - RAF Marham, NorfolkThursday 21 and Friday 22 August - Clacton Air Show 2014 - www.clactonairshow.com - Clacton-on-Sea, EssexSaturday 23 August - Dawlish Air Show - www.dawlishairshow.co.uk/ - Dawlish, DevonSunday 24 August - Dunsfold Wings & Wheels 2014 - www.wingsandwheels.net/ - Dunsfold Aerodrome, SurreySunday 24 August - Little Gransden Air & Car Show - http://www.littlegransdenshow.co.uk/ - Little Gransden, Cambridgeshire28-30 August - Air Festival 2014 - www.bournemouthair.co.uk/ - Bournemouth, DorsetSaturday 30 August - Shoreham Air Show 2014 - Shoreham, West SussexSaturday 30 August - Dartmouth Royal Regatta - www.dartmouthregatta.co.uk - Dartmouth, UKSunday 31 August - Air Festival 2014 - www.bournemouthair.co.uk - Bournemouth, DorsetSunday 28 September - Battle of Britain Memorial Flight - www.lancasterassociation.co.uk - RAF Coningsby in Lincolnshire . Beautiful sight: The Avro Lancaster is one of the Second World War's most-recognisable British aircraft . Famous film: A scene from 1955 movie The Dam Busters - released 12 years after the raid - showing the bouncing bomb suspended from the belly of the Lancaster . The Avro Lancaster is one of the Second World War's most-recognisable British aircraft. It is most famous for the Dambusters . raids, which saw 19 Lancasters attack German dams with Sir Barnes . Wallis's 'bouncing bombs' in 1943. Vera - built two years after the raids, in 1945 - was acquired by Canadian Warplane Heritage Museum in 1978 and . underwent a 10-year restoration. Lord of the Rings director Peter Jackson has also been on board the bomber in preparation for a new film about the Dambusters. On May 16, 1943, 19 aircraft set out . to destroy three dams in the Ruhr valley - the Mohne, the Eder and the . Sorpe. The idea was to damage a vital source of power to the key industrial area of Germany. The strategic targets not only supplied hydro-electric power, and water for steel-making, but also supplied drinking water. The squadron was assembled by Wing . Commander Guy Gibson with only 11 weeks to prepare for their mission - . using special bouncing bombs, invented by Barnes Wallis. They were not told that they would be . bombing the Ruhr valley until six hours before the raid began, following . weeks of practice over Peak District reservoirs. On the night of the mission - . codenamed Operation Chastise - the 113 crewmen took off in three waves . along two different routes to bomb the dams. Gibson attacked first at the Möhne at 12.28am, but five bombs were dropped before it was breached. The first wave’s three remaining aircraft with bombs then attacked the Eder which finally collapsed at 1.52am. Aircraft from the other two waves . bombed the Sorpe but it remained intact. Although the mission was hailed . a success, eight aircraft and 53 crew were lost during the raids.",Two World War II-era Lancaster bombers flew together in the skies over Britain yesterday for the first time in 50 years. The world's only two airworthy Lancaster bombers were united on a windswept Lincolnshire airfield for what will probably be one of the last times.,902,0.491,45,0.867 +18,"Andy Murray knows there can be no let up in his quest to secure a place at the season-ending ATP World Tour Finals as he heads to Valencia on the back of a hard-earned victory over David Ferrer in the final of the Erste Open in Vienna. The British number one recovered from losing the opening set to break serve three times in the decider and clinch a 5-7 6-2 7-5 victory in two hours and 40 minutes, which earned him crucial points in the Race to London. Murray, 27, is now the holder of the eighth and final qualifying berth for tournament hosted at The O2, with Tomas Berdych's win against Grigor Dimitrov in the final of the Stockholm Open later on Sunday consolidating the Czech's seventh position. Andy Murray lifts the Erste Open trophy in Vienna after a three set victory against David Ferrer . The Scot is now in position to reach the World Tour Finals after moving into the eighth qualifying position . The margins, though, are slim heading into the last two ranking events of the regular 2014 season, the Valencia Open 500, where Murray will play, and the Swiss Indoors Basel preceding the BNP Paribas Masters, which carries double the qualification points. Some six players are realistically left chasing the three remaining places, with Marin Cilic, who on Sunday won the Kremlin Cup in Moscow, qualified as a Grand Slam winner, from the US Open. 'The next few weeks are extremely important, everyone is playing next week,' said Murray on www.atpworldtour.com. 'I just need to win as many matches as possible to keep hold of the eighth spot or go higher.' Murray will now compete at the Valencia Open 500 as he bids to secure his position in London . Murray has been battling to regain top form again this year, the 2013 Wimbledon champion having fallen down the world rankings to number 11, but he claimed the inaugural Shenzhen Open title at the end of September and now after Vienna has some 30 ATP Tour wins. He added on BBC Radio Five Live: 'I was starting to feel good at the US Open a few months ago and I wanted to try and continue that through until the end of the year. 'Obviously, London would be very nice if I can get there, but it is also important for seedings at the Australian Open. 'To be seeded in the top eight there can make a big difference to the draw and hopefully I will be able to do that.' David Ferrer, pictured playing a backhand shot against Murray, could also make the World Tour Finals . Ferrer, meanwhile, still harbours genuine hopes of making it to London - the Spaniard is currently in ninth place but only 100 points behind the Scot going into Valencia. 'I have reached the final (here), so it is positive,' said Ferrer, who had beaten Murray in the third round of last week's Shanghai Rolex Masters. 'Andy played more aggressively than I did in the crucial moments and he deserved to win. 'Of course, I am disappointed as I lost the match having had a 5-3 lead (in the third set). 'I have a chance (to qualify for London). There are two more weeks, which are important to get to London. I will try and be more positive next week.'",Andy Murray beat David Ferrer in the final of the Erste Open in Vienna. The victory earned him crucial points in the Race to London. Murray is now the holder of the eighth and final place in the ATP World Tour Finals. He will play in Valencia.,562,0.552,47,0.745 +19,"A lifelong dream becomes reality for Chris Cork in Buenos Aires on Sunday, as the former punk rocker from High Wycombe sits on his bike to begin the world’s most punishing motorsport event. The 43-year-old Englishman, a builder by trade, will put his bike, body and possibly even his life on the line during the Dakar, the 5,500-mile race across the Andes and the Atacama desert. He has left his partner and two sons, including three-month-old Oliver, behind and even sold their farm to fund his ride of a lifetime. Chris Cork is set to embark on the the 5,500-mile Dakar race across the Andes and the Atacama desert . Cork, a builder by trade, has left his partner and two sons to embark on his race of a lifetime . ‘He’s always wanted to do the Dakar, it’s been a dream of his,’ said partner Mel, who remains confident, if a little anxious. ‘He’s quite a safe rider, it’s just everything else that goes into the equation that worries me. It’s a bit of a mixed bag because I’m excited for him but obviously it’s a bit tricky here for the next three weeks with two young kids.’ And that’s also the hardest part for Cork, who once upon a time played drums and bass in punk bands Chineapple Punx and Blossom, but nowadays is found doting on Mel and the children. ‘I have pictures of my two sons with me at all times and I miss them greatly,’ he said. Thoughts of home will disappear on Sunday, however, when Cork lines up at the start of one of the most gruelling and dangerous of all races. A total of 665 competitors will leave Buenos Aires in cars and trucks and on quad bikes and motorcycles. British interest is restricted to a mere eight racers, a far cry from the heyday of the old Paris-Dakar when dozens of home hopefuls would cross the Channel and begin the epic journey down to Dakar in Senegal. Cork will be one of 665 competitors racing in in cars and trucks and on quad bikes and motorcycles . Cork, whose preparations for the rally have not been ideal - he broke his wrist in August and crashed out of the Rally of Morocco in October - is Britain’s only amateur rider this year, though Paul Round from Huddersfield and Mike Jones, from Sandbach, founders of Rally Raid UK, continue to fly the flag in all categories, taking four cars, two trucks and two bikes. Crossing the barren terrain of Argentina, Chile and Bolivia sounds daunting enough, but Jones paints an even scarier picture. ‘The Dakar is an addiction, it takes over your life,’ he explained. ‘The organisation are out to break you and your vehicle, simple as that. ‘Some of the terrain looks mind blowing when you see it and you never believe a vehicle can cross it, let alone at speed. ‘You can be 3km off track and still be classed as on course, yet a 10-metre deviation in the desert can be a smooth fast track or a 500ft-deep canyon. The route designer puts secret waypoints that must be passed by into the most devilish places, at the top of the steepest dunes and the bottom of the biggest holes and sand pits. ‘In the daylight it is difficult, when the sun goes down it really sorts the men from the boys or the girls from the women.’ 43-year-old's preparations have been far from ideal having broken a wrist in August . Of the eight British competitors at Dakar this year it is with Cork’s sole compatriot in the bike category, Sam Sunderland, where British hopes lie. Sunderland, 25, has secured a ride with the dominant KTM squad, on the back of taking the second stage win riding a works Honda in last year’s Dakar. For Cork, however, ambitions are more modest. Given what lies ahead, the endless tests over unyielding surfaces, in extreme temperatures, from sea level to the peaks of the Andes and back, he speaks for the majority when he says: ‘My expectation is simply to finish.’ Britain's Sam Sunderland will be riding at Dakar with the dominant KTM squad .","Chris Cork will start his Dakar journey in Buenos Aires on Sunday. The former punk rocker from High Wycombe sold his farm to fund his journey. He has left his partner and two sons behind and will bike 5,500 miles across the Andes and the Atacama desert.",703,0.545,47,0.851 diff --git a/examples/streamlit/annotation/wandb_streamlit_app.py b/examples/streamlit/annotation/wandb_streamlit_app.py new file mode 100644 index 00000000..1d269017 --- /dev/null +++ b/examples/streamlit/annotation/wandb_streamlit_app.py @@ -0,0 +1,234 @@ +import pandas as pd +import streamlit as st + +from io import StringIO + +st.set_page_config( + page_title="W&B Annotation", + # page_icon="🧊", + layout="wide", +) +st.markdown('''''', unsafe_allow_html=True) + +st.image("images/wandb-streamlit-logo.png") +st.title('Custom annotation of W&B Tables with the Streamlit data editor') +st.write('Summarization can be a critical but challenging language modeling task, with varying manual and automated approaches that prove hard to evaluate and compare. [Weights & Biases]("https://wandb.ai/site") helps machine learning practitioners log summary inputs and results from multiple experimental approaches and interrogate and evaluate those results effectively at scale. [Streamlit’s data editor]("https://docs.streamlit.io/library/api-reference/data/st.data_editor"), showcased in this application, helps teams responsible for annotating modeling results for interim and final assessments in language modeling pipelines interact with these results and revise them for downstream tasks (e.g., creating gold standard examples or fine-tuning).') + +st.write('This application takes an input csv file of news articles and automated summaries using [BART]("https://huggingface.co/facebook/bart-large-cnn") and [BART-SAMSUM]("https://huggingface.co/philschmid/bart-large-cnn-samsum") and allows a user to smoothly evaluate summaries from multiple approaches. Specifically, a user can:') + +st.markdown(''' + 1. select whether an automated summary requires adjustment (***needs_revision** column*) + 2. enter a suggested summary approach from a drop-down menu (***approach** column*) + 3. enter a manual edition of the current summary (***manual_edition** column*) + 4. add optional comments for the revision (***comments** column*) + +''') + +st.write('Users can upload two separate files to compare experimental results from different approaches and annotate dynamically in-app.') + +with st.expander("See additional resources"): + + st.link_button("Annotation Colab notebook", "https://colab.research.google.com/drive/133sV8VgY5wftiDpjIT3UnNcvBwTQzfSa?usp=sharing") + st.link_button("W&B project for Tables integration", "https://wandb.ai/claire-boetticher/news_summarization?workspace=user-claire-boetticher") + +# first dataframe with manual revision columns + +uploaded_file = st.file_uploader("Choose a file for summary review (Approach 1)", key="bart") +if uploaded_file is not None: + + # Read csv as dataframe + dataframe = pd.read_csv(uploaded_file) + dataframe.rename(columns={'Unnamed': 'Row'}, inplace=True) + + # Reorder index from random sample row numbers - optional + # dataframe.reset_index(drop=True) + + # Add empty column for free text comments + dataframe['needs_revision'] = '' + dataframe['approach'] = '' + dataframe['manual_edition'] = '' + dataframe['comments'] = '' + + # Display dataframe in app + bart_edited_df = st.data_editor(dataframe, + column_config={ + "needs_revision": st.column_config.CheckboxColumn( + "needs_revision", + help="Does the Summary column need to be changed?", + width="medium", + default=False, + required=True, + ), + "approach": st.column_config.SelectboxColumn( + "approach", + help="Select approach for revising summary", + width="medium", + options=[ + "Manual edit", + "Adjust model", + "Other (add suggestion in Comments column)" + ], + required=False, + ), + "manual_edition": st.column_config.TextColumn( + "manual_edition", + help="Enter new summary", + width="medium", + required=False, + ), + "comments": st.column_config.TextColumn( + "comments", + help="Describe reasoning for editing the current assigned Summary value", + width="large", + required=False, + ), + }, + # disabled freezes columns so users cannot change the values + disabled=("articles", "bart_summaries", "source_word_count", "summary_word_count", "source_lexical_diversity", "summary_lexical_diversity"), + hide_index=True, + column_order=("articles", "bart_summaries", "needs_revision", "approach", "manual_edition", "comments", "source_word_count", "summary_word_count", "source_lexical_diversity", "summary_lexical_diversity"), + num_rows="dynamic" + + ) + +# second dataframe with different columns and metrics for evaluation + +uploaded_file = st.file_uploader("Choose a file for summary review (Approach 2)", key="samsum") +if uploaded_file is not None: + + # Read csv as dataframe + dataframe = pd.read_csv(uploaded_file) + dataframe.rename(columns={'Unnamed': 'Row'}, inplace=True) + + # Reorder index from random sample row numbers - optional + # dataframe.reset_index(drop=True) + + # Add empty column for free text comments + dataframe['relevance'] = '' + dataframe['coherence'] = '' + dataframe['consistency'] = '' + dataframe['fluency'] = '' + dataframe['needs_revision'] = '' + dataframe['approach'] = '' + dataframe['manual_edition'] = '' + dataframe['comments'] = '' + + # Display dataframe in app + samsum_edited_df = st.data_editor(dataframe, + column_config={ + "relevance": st.column_config.SelectboxColumn( + "relevance (1-5)", + help="select a relevance score from 1 (lowest) to 5 (highest)", + width="medium", + options=[ + "1", + "2", + "3", + "4", + "5" + ], + ), + "coherence": st.column_config.SelectboxColumn( + "coherence (1-5)", + help="select a coherence score from 1 (lowest) to 5 (highest)", + width="medium", + options=[ + "1", + "2", + "3", + "4", + "5" + ], + ), + "consistency": st.column_config.SelectboxColumn( + "consistency (1-5)", + help="select a consistency score from 1 (lowest) to 5 (highest)", + width="medium", + options=[ + "1", + "2", + "3", + "4", + "5" + ], + ), + "fluency": st.column_config.SelectboxColumn( + "fluency (1-5)", + help="select a fluency score from 1 (lowest) to 5 (highest)", + width="medium", + options=[ + "1", + "2", + "3", + "4", + "5" + ], + ), + "needs_revision": st.column_config.CheckboxColumn( + "needs_revision", + help="Does the summary column need to be changed?", + width="medium", + default=False, + required=True, + ), + "manual_edition": st.column_config.TextColumn( + "manual_edition", + help="Enter new summary", + width="medium", + required=False, + ), + "comments": st.column_config.TextColumn( + "comments", + help="Describe reasoning for editing the current assigned Summary value", + width="large", + required=False, + ), + }, + # disabled freezes columns so users cannot change the values + disabled=("articles", "bart_samsum_summaries", "source_word_count", "summary_word_count", "source_lexical_diversity", "summary_lexical_diversity"), + hide_index=True, + column_order=("articles", "bart_samsum_summaries", "relevance", "coherence", "consistency", "fluency", "needs_revision", "manual_edition", "comments", "source_word_count", "summary_word_count", "source_lexical_diversity", "summary_lexical_diversity"), + num_rows="dynamic" + + ) + + +## Add session state logic so that if Needs Revision is True, other columns are required +# import pandas as pd +# import streamlit as st + +# data_df = pd.DataFrame( +# { +# "widgets": ["st.selectbox", "st.number_input", "st.text_area", "st.button"], +# "favorite": [True, False, False, True], +# } +# ) + +# st.data_editor( +# data_df, +# column_config={ +# "favorite": st.column_config.CheckboxColumn( +# "Your favorite?", +# help="Select your **favorite** widgets", +# default=False, +# ) +# }, +# disabled=["widgets"], +# hide_index=True, +# ) diff --git a/examples/streamlit/quickstart/README.md b/examples/streamlit/quickstart/README.md new file mode 100644 index 00000000..a4cb8f9f --- /dev/null +++ b/examples/streamlit/quickstart/README.md @@ -0,0 +1,40 @@ +# Using W&B and Streamlit + +## Description + +Example repo to show off the different possibilties when utilizing both W&B and Streamlit. In this repo we hit two scenarios in terms of interaction with W&B and Streamlit. + +1. Embed an IFrame of the WANDB dashboard within the Streamlit application. This is shown in the application when selecting the `Embed IFrame` option. In this variant we allow users to select a project and run. We then display both the project dashboard and run dashboard from WANDB + +2. Use WANDB traiditionally to log artifacts that can be pulled from an experiment to visualize traditionally. This is shown in the application when selecting the `Use WANDB Logging` option. In this variant we provide a minimal example of an WANDB experiment that can be run to the users account upon click. When said experiment is finished, it should load in a logged HTML page saved in WANDB to the file directory of the Streamlit project to then be displayed by Stteamlit. + +## Install + +``` +pip install -r requirements.txt +``` + +Generate a `.env` file in the root of the project with variables: + +``` +WANDB_API_KEY= +WANDB_ENTITY= +``` + +## Usage + +To run streamlit on localhost use command: `streamlit run wandb_streamlit_app.py` + +## Examples + +### WANDB Project Dashboard + + + +### WANDB Run Dashboard + + + +### WANDB HTML Artifact rendered via Streamlit + + diff --git a/examples/streamlit/requirements.txt b/examples/streamlit/quickstart/requirements.txt similarity index 100% rename from examples/streamlit/requirements.txt rename to examples/streamlit/quickstart/requirements.txt diff --git a/examples/streamlit/static/gifs/embed_wandb_project_dash.gif b/examples/streamlit/quickstart/static/gifs/embed_wandb_project_dash.gif similarity index 100% rename from examples/streamlit/static/gifs/embed_wandb_project_dash.gif rename to examples/streamlit/quickstart/static/gifs/embed_wandb_project_dash.gif diff --git a/examples/streamlit/static/gifs/embed_wandb_run_dash.gif b/examples/streamlit/quickstart/static/gifs/embed_wandb_run_dash.gif similarity index 100% rename from examples/streamlit/static/gifs/embed_wandb_run_dash.gif rename to examples/streamlit/quickstart/static/gifs/embed_wandb_run_dash.gif diff --git a/examples/streamlit/static/gifs/use_wandb_logging.gif b/examples/streamlit/quickstart/static/gifs/use_wandb_logging.gif similarity index 100% rename from examples/streamlit/static/gifs/use_wandb_logging.gif rename to examples/streamlit/quickstart/static/gifs/use_wandb_logging.gif diff --git a/examples/streamlit/wandb_streamlit_app.py b/examples/streamlit/quickstart/wandb_streamlit_app.py similarity index 100% rename from examples/streamlit/wandb_streamlit_app.py rename to examples/streamlit/quickstart/wandb_streamlit_app.py diff --git a/examples/streamlit/wandb_utils.py b/examples/streamlit/quickstart/wandb_utils.py similarity index 100% rename from examples/streamlit/wandb_utils.py rename to examples/streamlit/quickstart/wandb_utils.py