Data¶
Overview¶
createData¶
Create a data with empty values.
Available data types: 'Chatbot', 'IntentNER', 'SpeakerVerification'.
1 | createData -n 'data name' -t 'DataType' |
Keyword Arguments:
-
-n, --name (
str
) -- Name of data -
-t, --type (
str
) -- Type of data (based on the model)
dataAddEmbedding¶
Add word embedding to data
1 | dataAddEmbedding -n 'data name' -e 'embedding name' |
Keyword Arguments:
-
-n, --name (
str
) -- Name of data to add on -
-e, --embedding (
str
) -- Name of embedding
dataReset¶
Reset a data, clearing all stored data values.
1 | dataReset -n 'data name' |
Keyword Arguments:
- -n, --name (
str
) -- Name of data to reset
deleteData¶
Delete a data.
1 | deleteData -n 'data name' |
Keyword Arguments:
- -n, --name (
str
) -- Name of data to delete
saveData¶
Save a data.
1 | saveData -n 'data name' |
Keyword Arguments:
- -n, --name (
str
) -- Name of data to save
loadData¶
Load a data.
1 | loadData -n 'data name' |
Keyword Arguments:
- -n, --name (
str
) -- Name of data to load
exportData¶
Export a data to zip file.
1 | exportData -n 'data name' -p 'some\path\to\export\' |
Keyword Arguments:
-
-n, --name (
str
) -- Name of data to export -
-p, --path (
str
) -- Path to export file
importData¶
Import a data from zip file.
1 | importModel -n 'data name' -p 'some\path\to\export\data_name.zip' |
Keyword Arguments:
-
-n, --name (
str
) -- Name of data to import -
-p, --path (
str
) -- Path to import file
getData¶
Get a list of existing data.
1 | getData |
No argument required.
This command returns a dictionary of which the keys are the name of data and the values are the details.
The details will be empty if the data is not loaded.
1 2 3 4 5 6 | { "data_name": { "name": "data_name", "type": "<class 'data _class'>" } } |
getDataDetails¶
Return the details of a data.
1 | getDataDetails -n 'data name' |
Keyword Arguments:
- -n, --name (
str
) -- Name of data
1 2 3 4 5 6 7 8 9 10 | { 'model_config_saved_directory': 'resources\\model_configs', 'model_config_saved_name': 'model_config_name', 'model_config_name': 'model_config_name', 'embedding_saved_directory': 'resources\\embeddings\\embedding_name', 'embedding_saved_name': 'embedding_name', 'embedding_name': 'embedding_name', 'cls': 'ChatbotData', 'values': ['arr_0', 'embedding'] } |
Chatbot Data¶
chatbotDataAddTwitter¶
Add twitter dataset to a chatbot data.
1 | chatbotDataAddTwitter -n 'data name' -p '\some\path\twitter.txt' |
Keyword Arguments:
-
-n, --name (
str
) -- Name of data to add on -
-p, --path (
str
) -- Path to twitter file
chatbotDataAddCornell¶
Add Cornell dataset to a chatbot data.
1 | chatbotDataAddCornell -n 'data name' -mcp '\some\cornell\movie_conversations.txt' -mlp '\some\cornell\movie_lines.txt' |
Keyword Arguments:
-
-n, --name (
str
) -- Name of data to add on -
-mcp, --movie_conversations_path (
str
) -- Path to movie_conversations.txt in the Cornell dataset -
-mlp, --movie_lines_path (
str
) -- Path to movie_lines.txt in the Cornell dataset
chatbotDataAddFiles¶
Add text files to a chatbot data.
1 | chatbotDataAddFile -n 'data name' -x '\some\path\x.txt' -y '\some\path\y.txt' |
Keyword Arguments:
-
-n, --name (
str
) -- Name of data to add on -
-x, --x_path (
str
) -- Path to a UTF-8 file containing a raw sentence input on each line -
-y, --y_path (
str
) -- Path to a UTF-8 file containing a raw sentence output on each line
chatbotDataAddInput¶
Add input to a chatbot data.
1 | chatbotDataAddInput -n 'data name' -x 'hey how are you' |
Keyword Arguments:
-
-n, --name (
str
) -- Name of data to add on -
-x, --x (
str
) -- Raw sentence input
chatbotDataSetInput¶
Set input as a chatbot data.
1 | chatbotDataSetInput -n 'data name' -x 'hey how are you' |
Keyword Arguments:
-
-n, --name (
str
) -- Name of data to set -
-x, --x (
str
) -- Raw sentence input
IntentNER Data¶
intentNERDataSetIntentfolder¶
Set folder for IntentNER Data.
1 | intentNERDataSetIntentFolder -n 'data name' -p '\\some\\path\\to\\intents' |
Keyword Arguments:
-
-n, --name (
str
) -- Name of data to add on -
-p, --path (
str
) -- Path to a folder contains input files
intentNERDataAddInput¶
Add a raw sentence as an intent NER data.
1 | intentNERDataAddParseInput -n 'data name' -x 'hey how are you' |
Keyword Arguments:
-
-n, --name (
str
) -- Name of data to add on -
-x, --x (
str
) -- Raw sentence input
intentNERDataSetInput¶
Set a raw sentence as an intent NER data.
1 | intentNERDataSetParseInput -n 'data name' -x 'hey how are you' |
Keyword Arguments:
-
-n, --name (
str
) -- Name of data to set -
-x, --x (
str
) -- Raw sentence input
SpeakerVerification Data¶
speakerVerificationDataAddDataFolder¶
Add folder to a speaker verification data.
1 | speakerVerificationDataAddDataFolder -n 'data name' -p 'path' [-y True] |
Keyword Arguments:
-
-n, --name (
str
) -- Name of data to add on -
-p, -path (
str
) -- Path of folder to set -
-y, --y (
bool
) -- The label (True for is speaker and vice versa) of the audio files. Include for training, leave out for prediction. (Optional)
speakerVerificationDataSetDataFolder¶
set folder to a speaker verification data.
1 | speakerVerificationDataSetDataFolder -n 'data name' -p 'path' [-y True] |
Keyword Arguments:
-
-n, --name (
str
) -- Name of data to set -
-p, -path (
str
) -- Path of folder to set -
-y, --y (
bool
) -- The label (True for is speaker and vice versa) of the audio files. Include for training, leave out for prediction. (Optional)
speakerVerificationDataAddWavFile¶
Add wav file to a speaker verification data.
1 | speakerVerificationDataAddWavFile -n 'data name' -p '["\some\path\01.wav"]' [-y True] |
Keyword Arguments:
-
-n, --name (
str
) -- Name of data to add on -
-p, --path (
str
) -- Path to wav file -
-y, --y (
bool
) -- The label (True for is speaker and vice versa) of the audio files. Include for training, leave out for prediction. (Optional)
speakerVerificationDataSetWavFile¶
Set wav file to a speaker verification data.
1 | speakerVerificationDataSetWavFile -n 'data name' -p '["\some\path\01.wav"]' [-y True] |
Keyword Arguments:
-
-n, --name (
str
) -- Name of data to set -
-p, --path (
str
) -- Path to wav file -
-y, --y (
bool
) -- The label (True for is speaker and vice versa) of the audio files. Include for training, leave out for prediction. (Optional)
speakerVerificationDataAddTextFile¶
Add text file to a speaker verification data.
1 | speakerVerificationDataAddTextFile -n 'data name' -p '["\some\path\01.txt"]' [-y True] |
Keyword Arguments:
-
-n, --name (
str
) -- Name of data to add on -
-p, --path (
str
) -- Path to text file -
-y, --y (
bool
) -- The label (True for is speaker and vice versa) of the audio files. Include for training, leave out for prediction. (Optional)
speakerVerificationDataSetTextFile¶
Set text file to a speaker verification data.
1 | speakerVerificationDataSetTextFile -n 'data name' -p '["\some\path\01.txt"]' [-y True] |
Keyword Arguments:
-
-n, --name (
str
) -- Name of data to set -
-p, --path (
str
) -- Path to text file -
-y, --y (
bool
) -- The label (True for is speaker and vice versa) of the audio files. Include for training, leave out for prediction. (Optional)