Standard IEEE 3168-2024 9.8.2024 preview

IEEE 3168-2024

IEEE Standard for Robustness Evaluation Test Methods for a Natural Language Processing Service That Uses Machine Learning

Translate name

STANDARD published on 9.8.2024


Language
Format
AvailabilityIN STOCK
Price56.00 USD excl. VAT
56.00 USD

The information about the standard:

Designation standards: IEEE 3168-2024
Publication date standards: 9.8.2024
SKU: NS-1194502
The number of pages: 29
Approximate weight : 87 g (0.19 lbs)
Country: International technical standard
Category: Technical standards IEEE

Annotation of standard text IEEE 3168-2024 :

New IEEE Standard - Active.

The natural language processing (NLP) services using machine learning have rich applications in solving various tasks and have been widely deployed and used, usually accessible by application programming interface (API) calls. The robustness of the NLP services is challenged by various well-known general corruptions and adversarial attacks. Inadvertent or random deletion, addition, or repetition of characters or words are examples of general corruptions. Adversarial characters, words, or sentence samples are generated by adversarial attacks, causing the models underpinning the NLP services to produce incorrect results. A method for quantitatively evaluating the robustness the NLP services is proposed by this standard. Under the method, different cases the evaluation needs to perform against are specified. Robustness metrics and their calculation are defined. With the standard, understanding of the robustness of the services can be developed by the service stakeholders including the service developer, service providers, and service users. The evaluation can be performed during various phases in the life cycle of the NLP services, the testing phase, in the validation phase, after deployment, and so forth.

ISBN: 979-8-8557-0910-0, 979-8-8557-0911-7

Number of Pages: 29

Product Code: STD27073, STDPD27073

Keywords: artificial intelligence, evaluation metrics, IEEE 3168™, natural language processing service, robustness evaluation

Category: 309

We recommend:

Updating of laws

Do you want to be sure about the validity of used regulations?
We offer you a solution so that you could use valid and updated legislative regulations.
Would you like to get more information? Look at this page.




Cookies Cookies

We need your consent to use the individual data so that you can see information about your interests, among other things. Click "OK" to give your consent.

You can refuse consent here.

Here you can customize your cookie settings according to your preferences.

We need your consent to use the individual data so that you can see information about your interests, among other things.