Skip to content

Commit

Permalink
Updated content for 1.10.0 (#26)
Browse files Browse the repository at this point in the history
* Updated content for 1.10.0

* Various changes to the AI Retakes page for RLHF
* New section on the Setup page for Telemetry Consent
* Add the new track color picker to the Managing Tracks page
* Mention shifting lyrics forward/backward on Batch Lyric Input page

* Minor corrections to the Channel Layout option descriptions

* Changes for 1.10.0b2

* Add note about global retake sliders
  • Loading branch information
claire-west authored Oct 19, 2023
1 parent c59e5c5 commit 0b1d579
Show file tree
Hide file tree
Showing 26 changed files with 101 additions and 24 deletions.
6 changes: 6 additions & 0 deletions docs/advanced/batch-lyrics.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,12 @@ If the "Pattern Fill" option is selected and there are more notes selected than

![Pattern Fill Across Six Notes](../img/quickstart/lyric-pattern-fill-2.png)

## Shift Lyrics Forward/Backward

When entering lyrics for many notes at once, you may miscount the number of notes and end up with lyrics which are slightly offset from their intended destination. This can be quickly rectified by selecting the offset notes and choosing "Shift Lyrics Forward" (++ctrl+shift+right++) or "Shift Lyrics Backward" (++ctrl+shift+left++) from the right click menu.

![Shift Lyrics Forward](../img/advanced/shift-lyrics-forward.png)

## Video Demonstration

<iframe width="560" height="315" src="https://www.youtube-nocookie.com/embed/Gj7UipbHBdw?start=100" title="YouTube video player" frameborder="0" allowfullscreen></iframe>
Expand Down
3 changes: 2 additions & 1 deletion docs/advanced/right-click-menus.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ See [The Arrangement Panel](../workspace/arrangement.md) for an overview of UI e

### Existing Track

Delete or duplicate the track (see [Managing Tracks](../quickstart/managing-tracks.md)).
Delete, duplicate, or change the color for the track (see [Managing Tracks](../quickstart/managing-tracks.md)).

### Blank Space Below Tracks

Expand Down Expand Up @@ -58,6 +58,7 @@ Multiple options are displayed for interacting with the selected note(s) in vari
* Split the note at the current mouse position
* Merge the selected notes
* Open the [Insert Lyrics](batch-lyrics.md) dialog for the selection
* Shift the lyrics forward or backward for the selection
* Reset various aspects of the notes
* Generate or crop [AI Retakes](../ai-functions/ai-retakes.md)
* Recompute pitch for the selection (force re-rendering when using [Sing](../ai-functions/pitch-mode-sing.md) or [Rap](../ai-functions/pitch-mode-rap.md) pitch mode)
Expand Down
4 changes: 2 additions & 2 deletions docs/advanced/side-panels.md
Original file line number Diff line number Diff line change
Expand Up @@ -111,8 +111,8 @@ See [Setup and Activation](../setup.md)
**Automatically check for updates**
: Will check for updates to Synthesizer V Studio and any installed voice databases on startup.

**Allow telementry data collection**
: Sends anonymized usage information to Dreamtonics to improve the software, such as which features are used most often.
**Configure usage data collection**
: Displays the [Telemetry Consent](../setup.md#telemetry-consent) dialog.

### Audio
When standalone, contains options relating to your device's audio hardware.
Expand Down
30 changes: 24 additions & 6 deletions docs/ai-functions/ai-retakes.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,17 +11,31 @@ AI Retakes can be accessed via the [launch bar](../workspace/side-panels.md), an
![AI Retake Controls](../img/ai-functions/retakes-controls.png)

### 1. New Take

Generate new takes for the selected notes (default ++alt+t++).

### 2. Delete

Remove the take.

### 3. Multi Delete
### 3. Global Settings

The base Expressiveness and Enhancement values for all takes created for the current track/group.

Changing these values will retroactively affect existing takes. To "lock" the pitch curve of a note and prevent any retroactive changes, change its pitch mode to [Manual](../advanced/pitch-mode-manual.md).

### 4. Multi Delete

Options to delete unselected takes ("Crop to Active Takes") or only delete non-marked takes ("Crop to Active/Liked Takes", default ++shift+alt+t++).

### 4. Like
### 5. Like

Mark preferred takes.

If you have [opted in](../setup.md#ai-retakes-feedback-data), your feedback will be sent to Dreamtonics along with a minimal snippet of project data required to reconstruct your preferred retake. This information will be used to improve the generated pitch models in future software updates.

If not opted in, or after opting out of feedback collection, this functions only as a bookmark for your preferences, and no project data will be transmitted to Dreamtonics.

## Pitch

To generate new takes, select one or more notes and click "Generate Take" from the AI Retakes panel.
Expand All @@ -30,7 +44,7 @@ To generate new takes, select one or more notes and click "Generate Take" from t

![Generating New Takes](../img/ai-functions/retakes-new.png)

Pitch retakes will produce varying pitch curves, and can be used to fine tune note transitions and vibrato.
Pitch retakes will produce varying pitch curves, and can be used to fine-tune note transitions and vibrato.

By selecting different takes from the list you can see the pitch line change according to the selection.

Expand All @@ -54,12 +68,16 @@ These takes will modify the various qualities of a sound which are unrelated to

## Expressiveness

The expressiveness slider can be used to reduce the amplitude of pitch or timbre deviations.

When no notes are selected, this slider will affect the default expressiveness value for all notes in the track or group that have not had their expressiveness values set individually.
The expressiveness slider can be used to adjust the amplitude/intensity of pitch or timbre deviations.

![Side-by-side of Expressiveness Values](../img/ai-functions/retakes-expressiveness-crop.png)

## Enhancement

The enhancement slider determines how much the generated pitch patterns will be influenced by feedback collected from other users and surveys conducted by Dreamtonics.

Feedback-based enhancement is only available for Pitch retakes.

## Randomness and Probability

Generating new AI Retakes is comparable to rolling a die multiple times; the probability distribution and set of possible results does not change when a new "take" is generated, but you gain the ability to cycle through and select from many possibilites based on the same input or situation.
Expand Down
2 changes: 2 additions & 0 deletions docs/ai-functions/pitch-mode-rap.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,8 @@ Notice that the "Manual" button is dark, indicating that Manual Pitch Mode is di

A note's "context" is based on its pitch, duration, and phonemes, as well as those same properties of the notes before and after it. If any of these things change, the pitch deviations for the note will be recalculated.

If you like the generated pitch pattern for a note or sequence, consider enabling [Manual Mode](../advanced/pitch-mode-manual.md) for it to avoid accidentally triggering the automated pitch recalculation.

Enabling Rap Mode also allows the use of pitch [AI Retakes](ai-retakes.md).

### Rap Accent
Expand Down
2 changes: 2 additions & 0 deletions docs/ai-functions/pitch-mode-sing.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,8 @@ Notice that the "Manual" button is dark, indicating that Manual Pitch Mode is di

A note's "context" is based on its pitch, duration, and phonemes, as well as those same properties of the notes before and after it. If any of these things change, the pitch deviations for the note will be recalculated.

If you like the generated pitch pattern for a note or sequence, consider enabling [Manual Mode](../advanced/pitch-mode-manual.md) for it to avoid accidentally triggering the automated pitch recalculation.

Enabling Sing mode also allows the use of pitch [AI Retakes](ai-retakes.md).

### Vibrato Modulation
Expand Down
10 changes: 7 additions & 3 deletions docs/daw-integration/plugin.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ When Synthesizer V Studio is used as an instrument in a DAW, an additional setti

If "Save Inside Host" is selected, the Synthesizer V Studio project (SVP) file will be embedded within the DAW project.

To save an external SVP file separate from your DAW project, select "Save to External File" instead.
To save an external SVP file separate from your DAW project, select "Save to External File" instead. If your intention is to create an SVP backup of your project, ensure you switch back to "Save Inside Host" after saving the external file.

![Save Inside Host option](../img/daw-integration/save-inside-host.png)

Expand All @@ -40,13 +40,17 @@ Master Combined
: A single channel is used for all audio output.

Master Aspiration Isolated
: Two channels are used, one for the main output of all tracks and a second for the isolated aspiration of all tracks.
: Two channels are used, one for the phonation of all tracks and a second for the isolated aspiration of all tracks.

Track Combined
: One channel is used for each track.

Track Aspiration Isolated
: Two output channels are used for each track, one for the main output and the other for the isolated aspiration.
: Two output channels are used for each track, one for the phonation and the other for the isolated aspiration.

!!! note

Selecting an "Aspiration Isolated" option will remove the aspirant sounds from the main output, resulting in a base that only contains phonation. In this case the outputs must be recombined in the mixing process to have a complete result.

## Video Demonstration

Expand Down
Binary file added docs/img/advanced/shift-lyrics-forward.pdn
Binary file not shown.
Binary file added docs/img/advanced/shift-lyrics-forward.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/img/ai-functions/retakes-controls.pdn
Binary file not shown.
Binary file modified docs/img/ai-functions/retakes-controls.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/img/ai-functions/retakes-new.pdn
Binary file not shown.
Binary file modified docs/img/ai-functions/retakes-new.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file not shown.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/img/quickstart/change-track-color.pdn
Binary file not shown.
Binary file added docs/img/quickstart/change-track-color.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/img/quickstart/duplicate-track.pdn
Binary file not shown.
Binary file modified docs/img/quickstart/duplicate-track.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/img/quickstart/telemetry-consent.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
16 changes: 4 additions & 12 deletions docs/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,25 +20,17 @@ For official instructional content for SynthV Studio, check the Dreamtonics [vid

This website is not affiliated with Dreamtonics.

??? info "Update 1.9.0 now available! (click here for more information)"
??? info "Update 1.10.0 now available! (click here for more information)"

Dreamtonics has released Synthesizer V Studio version 1.9.0, introducing a major rework of Instant Mode, the addition of Rap vocals, and Cantonese cross-lingual synthesis.

The new and updated features are covered on the following pages:

* [Pitch Transition and Vibrato](note-properties/pitch-transition-and-vibrato.md) for a brief overview of the new Pitch Mode options.
* [Pitch Mode: Sing](ai-functions/pitch-mode-sing.md) for information about the new "Sing" mode, the successor feature to Instant Mode.
* [Pitch Mode: Rap](ai-functions/pitch-mode-rap.md) for everything relating to the new rap capabilities.
* [Manual Pitch Mode](advanced/pitch-mode-manual.md) for descriptions and diagrams relating to slider-based transition and vibrato (formerly on the "Pitch Transition and Vibrato" page).
* [Phoneme Reference](phonemes.md) for the list of Cantonese phonemes and a fancy new phoneme chart by TiredBee.
Dreamtonics has released Synthesizer V Studio version 1.10.0, with pitch model improvements based on human feedback and a selection of UX improvements.

For instructions on updating the software, see [Setup and Activation](setup.md#updating-the-software).

<iframe width="560" height="315" src="https://www.youtube-nocookie.com/embed/Z6OB3jHiBBk" title="YouTube video player" frameborder="0" allowfullscreen></iframe>
<iframe width="560" height="315" src="https://www.youtube-nocookie.com/embed/ZKwGR08kCSk" title="YouTube video player" frameborder="0" allowfullscreen></iframe>

Update notes from Dreamtonics:

* [Synthesizer V Studio 1.9.0 Final Update](https://dreamtonics.com/synthesizer-v-studio-1-9-0-final-update/)
* [Synthesizer V Studio 1.10.0 Final Update](https://dreamtonics.com/synthesizer-v-studio-1-10-0-final-update/)

---

Expand Down
2 changes: 2 additions & 0 deletions docs/keybinds.md
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,8 @@ While all options under the top menus can be assigned a hotkey, only those that
|View - Line Tool (Parameters panel) |++alt+3++ |++opt+3++ |
|View - Note Properties Panel |++ctrl+b++ |++cmd+b++ |
|Modify - Insert Lyrics (batch entry) |++ctrl+l++ |++cmd+l++ |
|Modify - Shift Lyric Forward |++ctrl+shift+right++ |++cmd+shift+right++|
|Modify - Shift Lyric Backward |++ctrl+shift+left++ |++cmd+shift+left++ |
|Modify - Simplify Parameters |++alt+s++ |++opt+s++ |
|Modify - Create Anchor Points |++alt+a++ |++opt+a++ |
|Modify - Snap to Grid |++ctrl+g++ |++cmd+g++ |
Expand Down
10 changes: 10 additions & 0 deletions docs/note-properties/note-and-phoneme-timing.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,16 @@ Default phoneme timing is determined based on the phoneme's type (vowel, stop, f

![Phoneme Timing Side-by-side](../img/note-properties/phoneme-timing-crop.png)

### Evenly Split Note Into Syllables

A multi-syllable lyric entered in a single note will be treated as a series of equal-length notes with syllable breaks while the "Evenly split note into syllables" checkbox is enabled.

This is suitable for multi-syllable words that do not change pitch over the entire duration, and which have equal timing for each syllable. Lyrics that do not meet this critera should have their syllables split across multiple notes with syllable breaks (`+`).

Notice how in this example, the phoneme timings are exactly the same for each instance of the word "synthesizer".

![Evenly slit note into syllables](../img/note-properties/evenly-split-syllables.png)

### More Precise Timing Adjustments

If the phoneme timing sliders do not offer enough precision, or the timing needs to be adjusted beyond the 20-180% range, it can be helpful to separate each phoneme into its own note.
Expand Down
10 changes: 10 additions & 0 deletions docs/parameters/editing-parameters.md
Original file line number Diff line number Diff line change
Expand Up @@ -42,6 +42,14 @@ In this example, SOLARIA's "Light" Vocal Mode and the Breathiness parameter are

The vertical position of a curve at a given point in time dictates the value of its respective parameter or vocal mode at that moment. For example, the "Light" Vocal Mode curve shown in the foreground is at approximately 105% at the start of the phrase, then slowly falls to around 30%, building to approximately 135% near the end of the phrase.

!!! note

Parameter curves are associated with their horizontal location along the time axis, not the notes that occur at that same point in time.

This means that moving, copying, or grouping a sequence of notes will not include the parameter values during the duration of that sequence unless you use the [Select Parameters for Notes](#select-parameters-for-notes) function to select them.

Some parameters such as Pitch Deviation will be specific to the notes they line up with, and so should be moved/copied/grouped along with their respective notes. Other parameters like Vocal Modes are generally applied to entire phrases, so moving those curves along with a specific note might not make sense in all situations.

![Base Parameter Sliders](../img/parameters/parameter-curve-example.png)

## Base Values
Expand Down Expand Up @@ -177,6 +185,8 @@ The Select Parameters for Notes option can be found under the "Edit" top menu, a

This function will select all parameter points for the currently selected notes. The parameter points for all parameter types will be selected, even if they are not visible in the Parameters panel.

This is especially helpful when copying or grouping a sequence while retaining the associated parameter curves.

See [Editing Notes](../quickstart/editing-notes.md#selecting-notes) for methods of selecting many notes at once using hotkeys and modifier keys.

![type:video](../img/parameters/move-params-with-notes.mp4)
Expand Down
8 changes: 8 additions & 0 deletions docs/quickstart/managing-tracks.md
Original file line number Diff line number Diff line change
Expand Up @@ -37,6 +37,14 @@ Notes from other tracks will be shown in the piano roll as colored lines. This c

![Create a Track](../img/quickstart/show-other-tracks.png)

### Changing a Track's Color

A track's color can be changed from the right click menu.

The track color is used in the Arrangement panel, as well as for the horizontal lines used to show non-current tracks in the Piano Roll. The color of the current track's notes in the Piano Roll is based on each note's pitch mode ("Sing" or "Rap"), not the track's assigned color.

![Changing the Track Color](../img/quickstart/change-track-color.png)

## Importing Tracks

There are two options in the "File" menu at the top of the application that allow importing of tracks.
Expand Down
22 changes: 22 additions & 0 deletions docs/setup.md
Original file line number Diff line number Diff line change
Expand Up @@ -92,6 +92,28 @@ Once you have successfully installed a voice database (and activated it, if nece

![Singer Selection Dropdown](img/quickstart/singer-dropdown-arrangement.png)

## Telemetry Consent

Upon launching the software for the first time, you will be presented with the Telemetry Consent dialog.

These options can always be changed via the "Configure usage data collection" button near the top of the Settings panel.

![Telemetry Consent dialog](img/quickstart/telemetry-consent.png)

### Application usage data

If checked, information about how you use the software will be sent to Dreamtonics. This includes how often each feature is used, render times, crash reports, and other anonymous data.

This information can help the development team identify which features might be confusing to users, which features are considered most useful, any hardware configurations that cause poor performance, etc.

### AI Retakes feedback data

If checked, information about [AI Retakes](ai-functions/ai-retakes.md) you "Like" (those marked with the heart icon) will be sent to Dreamtonics.

These preferred takes can be used by the development team to refine the AI pitch models to improve the reliability, consistency, and realism of the synthesized voices in future updates.

The transmitted retakes include minimal snippets of project data required to reconstruct your preferred retake, such as note duration and pitch, phoneme data, the selected voice database, etc. This collected data is strictly controlled by Dreamtonics and is used exclusively for research and development purposes.

## Updating the Software

Open the License and Updates panel and click "Check for Updates" to search for updates.
Expand Down

0 comments on commit 0b1d579

Please sign in to comment.