Fa'aigoaina Fa'ailoa Fa'amatalaga Fa'apitoa
Tatala faʻamatalaga taua i faʻamatalaga e leʻi faʻatulagaina faʻatasi ai ma faʻalapotopotoga faʻapitoa ile NLP
Tagata o loʻo faʻaalia
Faamalosia 'au e fausia lalolagi-taʻimua AI oloa.
Va'ai i le saoasaoa o lo'o gaosia ai fa'amaumauga; o le 80% e le faʻatulagaina, o loʻo i ai se manaʻoga i luga o le eleele e faʻaogaina tekinolosi e sosoo ai e faʻavasega lelei faʻamaumauga ma maua ai faʻamatalaga anoa mo le faia o filifiliga sili atu. Fa'ailoga Fa'aigoa Fa'aigoaina (NER) i le NLP o lo'o taula'i muamua i le fa'agaioiina o fa'amaumauga e le'i fa'atulagaina ma fa'avasegaina nei fa'aigoa igoa i fa'avasegaga.
IDC, Ofisa Su'esu'e:
O le lalolagi fa'apipi'i fa'avae o le fa'aputuga gafatia o le a o'o atu 11.7 zettabytes in 2023
IBM, Gartner & IDC:
80% o faʻamaumauga i le salafa o le lalolagi e le faʻatulagaina, ua le toe faʻaaogaina ma le faʻaaogaina.
O le a le NER
Su'esu'e fa'amaumauga e maua ai fa'amatalaga anoa
Named Entity Recognition (NER), fa'ailoa ma fa'avasega fa'alapotopotoga e pei o tagata, fa'alapotopotoga, ma nofoaga i totonu o tusitusiga e le'i fa'atulagaina. O le NER e faʻaleleia le suʻeina o faʻamaumauga, faʻafaigofie le toe maua o faʻamatalaga, ma faʻamalosia le faʻalauteleina o talosaga AI, ma avea o se meafaigaluega taua mo pisinisi e faʻaogaina. Faatasi ai ma le NER, e mafai e faʻalapotopotoga ona maua ni faʻamatalaga taua, faʻaleleia le poto masani o tagata faʻatau, ma faʻafaigofie faiga.
Shaip NER ua mamanuina e faʻataga ai faʻalapotopotoga e tatalaina faʻamatalaga taua i faʻamatalaga e leʻi faʻatulagaina & faʻatagaina oe e maua sootaga i totonu o faʻalapotopotoga mai faʻamatalaga tau tupe, pepa inisiua, iloiloga, faʻamatalaga a fomaʻi, ma isi. - faʻamatalaga faʻapitoa e faʻatautaia galuega faʻamatalaga o soʻo se fua.
NER Auala
O le sini autu o se faʻataʻitaʻiga NER o le faʻailoga poʻo le faʻailogaina o faʻalapotopotoga i totonu o tusitusiga ma faʻavasegaina mo aʻoaʻoga loloto. O auala nei e tolu e masani ona faʻaaogaina mo lenei faʻamoemoe. Ae ui i lea, e mafai ona e filifili e tuʻufaʻatasia se tasi pe sili atu foi metotia. O auala eseese i le fausiaina o faiga NER o:
Lomifefiloi fa'avae
faiga
Atonu o le auala sili lea ona faigofie ma fa'avae NER. O le a fa'aogaina se lomifefiloi e tele upu, upu tutusa, ma le aoina o upu. O le a siaki e le faiga pe iai se vaega patino o lo'o i totonu o le tusitusiga o lo'o avanoa fo'i i le vaogagana. I le faʻaaogaina o se algorithm matching string, e faia ai se suʻesuʻega o faʻalapotopotoga. Tose mana'oga mo le fa'aleleia pea o le fa'amaumauga o upu mo le fa'atinoina lelei o le fa'ata'ita'iga NER.
Fa'avae tulafono
faiga
Fa'amatalaga fa'avae e fa'avae i luga o se seti o tulafono fa'atulagaina muamua, o le
Tulafono fa'avae - E pei ona taʻu mai e le igoa, o se tulafono faʻavae e mulimulitaʻi i se morphological mamanu poʻo se manoa o upu o loʻo faʻaogaina i totonu o le pepa.
Tulafono fa'avae – O tulafono fa'avae e fa'atatau i le uiga po'o le fa'amatalaga o le upu i totonu o le pepa.
Faiga fa'avae a'oa'oga i masini
I masini fa'avae a'oa'oga, fa'ata'ita'iga fa'afuainumera e fa'aogaina e iloa ai fa'alapotopotoga. O se fa'ata'ita'iga fa'avae fa'avae o le tusitusiga o lo'o fa'aaogaina i lenei faiga. E mafai ona e fa'ato'ilaloina le tele o fa'aletonu o auala muamua e lua talu ai e mafai e le fa'ata'ita'iga ona iloa ituaiga fa'aletino e ui lava i nai suiga laiti o latou sipelaga mo a'oa'oga loloto.
Faʻafefea ona matou fesoasoani
- Aoao NER
- Fomai NER
- PII Fa'amatalaga
- Fa'amatalaga PHI
- Fa'amatalaga o Fuaitau Autu
- Fa'amatalaga Fa'alavelave
Talosaga a le NER
- Lagolagoina tagata fa'atau
- Manuia lelei a Tagata Faigaluega
- Fa'avasegaga Fa'afaigofie
- Faʻaleleia le tausiga o le onosaʻi
- Fa'asilisiliina Su'e Su'e
- Fautuaga sa'o i totonu
Faʻaaoga Tulaga
- Fa'amatalaga Aveese & Faiga Fa'ailoga
- Faiga o Fesili-Tali
- Faiga Faaliliuga a Masini
- Faiga Fa'aotootoga
- Semantic Annotation
Fa'asologa o Fa'amatalaga NER
E masani ona ese le fa'asologa o fa'amatalaga a le NER i mana'oga a le tagata o tausia ae e tele lava ina aofia ai:
Vaega 1: Tomai fa'apitoa fa'apitoa (Malamalama i le lautele o le poloketi & ta'iala fa'amatalaga)
Vaega 2: A'oa'oina punaoa talafeagai mo le poloketi
Vaega 3: Fa'asologa o fa'amatalaga ma QA o pepa fa'amatalaga
Tatou Tomai Faapitoa
1. Fa'ailoga Fa'aigoa Fa'alapotopotoga (NER)
Fa'aigoaina Fa'ailoga Fa'aigoaina i Masini A'oa'oga o se vaega o le Fa'agaioiina o Gagana Faanatura. O le fa'amoemoe autu o le NER o le fa'agaioiina o fa'amaumauga fa'atulagaina ma le fa'atulagaina ma fa'avasegaina fa'aigoa fa'aigoaina i ni fa'avasegaga. O nisi o vaega masani e aofia ai le igoa, nofoaga, kamupani, taimi, tulaga tau tupe, mea na tutupu, ma isi mea.
1.1 Vaega Lautele
Fa'ailoaina o tagata, nofoaga, fa'alapotopotoga ma isi i totonu ole vaega lautele
1.2 Vaega Inisiua
E aofia ai le aveeseina o faʻalapotopotoga i pepa inisiua e pei o
- Tupe inisiua
- Tapula'a o Fa'asalaga/faiga fa'avae
- Tala fa'atatau e pei o le lola totogi, fa'aliliuina, tupe maua totogi, fa'aulufale mai/fa'aulufale mai
- Fa'asologa o ta'avale
- Fa'aopoopoga o faiga fa'avae ma tapula'a i totonu
1.3 Vaega Fa'afoma'i / Foma'i NER
Fa'ailoaina o fa'afitauli, fausaga fa'aanatomi, vaila'au, fa'asologa mai fa'amaumauga fa'afoma'i e pei ole EHR; e masani lava e le fa'atulagaina i le natura ma e mana'omia le fa'aopoopoina o gaioiga e maua mai ai fa'amatalaga fa'atulagaina. E masani ona lavelave ma e manaʻomia ai tagata tomai faʻapitoa mai le soifua maloloina e faʻapipiʻi faʻalapotopotoga talafeagai.
2. Fa'amatalaga autu (KP)
E fa'ailoa ai se fa'aupuga nauna fa'apitoa i se tusitusiga. O se nauna e ono faigofie (fa'ata'ita'iga o le upu ulu e tasi e pei o le nauna, nauna sa'o po'o le suinauna) po'o le lavelave (fa'ata'ita'iga o se nauna e iai se upu ulu fa'atasi ma ona fa'aliliuga fa'atasi)
3. PII Fa'amatalaga
PII o lo'o fa'asino ile Fa'amatalaga Fa'asinomaga. O lenei galuega e aofia ai faʻamatalaga o soʻo se faʻamatalaga autu e mafai ona fesoʻotaʻi i tua i le faasinomaga o se tagata.
4. Fa'amatalaga PHI
O lo'o fa'asino le PHI i Fa'amatalaga Puipuia o le Soifua Maloloina. O lenei galuega e aofia ai faʻamatalaga o 18 faʻamatalaga autu maʻi e pei ona faʻaalia i lalo ole HIPAA, ina ia mafai ai ona faʻamaonia se faʻamaumauga / faʻamatalaga maʻi.
5. Fa'amatalaga Fa'alavelave
Fa'ailoaina o fa'amatalaga e pei o ai, o le a, o afea, o fea e uiga i se mea na tupu fa'ata'ita'iga Attack, kidnapping, Investment ma isi.
5.1. Fa'ailoga Fa'alapotopotoga (eg Tagata, nofoaga, faʻalapotopotoga, ma isi.
5.2. Fa'ailoaina o le upu e fa'ailoa ai le mea na tupu (ie upu fa'aoso)
5.3. Fa'ailoaina ole feso'ota'iga ile va ole fa'aoso ma ituaiga fa'alapotopotoga
Aisea Shaip?
Avatu Au
E fa'atatau e fa'aalu e saienitisi fa'amaumauga le silia ma le 80% o latou taimi i le tapenaina o fa'amaumauga. Faatasi ai ma le outsourcing, e mafai e lau 'au ona taulaʻi atu i le atinaʻeina o algorithms malosi, ma tuʻu ai le vaega faʻalavelave o le aoina o faʻamaumauga faʻaigoaina o faʻalapotopotoga ia i matou.
Scalability
Ole fa'ata'ita'iga ML ole a mana'omia le aoina ma le fa'ailogaina o pusi tetele o fa'amaumauga fa'aigoa, lea e mana'omia ai kamupani e toso mai alagaoa mai isi 'au. Faatasi ai ma paʻaga e pei o matou, matou te ofoina atu tagata tomai faʻapitoa e faigofie ona faʻalauteleina aʻo tuputupu aʻe lau pisinisi.
Tulaga Aupito Sili
O tagata tomai fa'apitoa fa'apitoa, o lo'o fa'ailoa mai aso-ma-ma-aso-o le a faia - so'o se aso - se galuega e sili atu pe a fa'atusatusa i se 'au, e mana'omia le fa'aogaina o galuega fa'amatalaga i a latou taimi pisi. E leai se aoga e fai atu, e maua ai le lelei sili atu.
Faʻatonuga o Meafaigaluega
O a matou faʻamaoniga faʻamaonia faʻamaumauga, faʻamaoniga o tekinolosi, ma le tele o vaega o le QA, e fesoasoani ia i matou e tuʻuina atu le tulaga sili ona lelei i totonu o le vasega e sili atu nai lo faʻamoemoega.
Saogalemu ma le faalilolilo
Matou te faʻamaonia mo le tausisia o tulaga maualuga o le saogalemu o faʻamatalaga ma le le faalauaiteleina aʻo galulue ma a matou tagata faʻatau e faʻamautinoa le le faalauaiteleina
Totogi Tauvaga
I le avea ai ma tagata atamamai i le faʻatulagaina, aʻoaʻoga, ma le puleaina o 'au o tagata faigaluega tomai, e mafai ona matou faʻamautinoa o loʻo tuʻuina atu galuega i totonu o le paketi.
Avanoa & Tiliva
O feso'ota'iga maualuga i luga-taimi & taimi-taimi tu'uina atu o fa'amaumauga, auaunaga & fofo.
Malosiaga i le Lalolagi
Faatasi ai ma le vaitaele o punaoa i luga o le matafaga & i fafo, e mafai ona tatou fausia ma fua 'au pe a manaʻomia mo tulaga faʻaoga eseese.
Tagata, Fa'agasologa & Fa'avae
Faatasi ai ma le tuʻufaʻatasia o le aufaigaluega i le lalolagi atoa, faʻavae malosi, & faʻagaioiga faʻatinoga na fuafuaina e 6 sigma black-belts, e fesoasoani ai Shaip e faʻalauiloa le sili ona luʻitau AI fuafuaga.
Fautuaina Punaoa
tesi
Fa'aigoaina Fa'aletino (NER) - Le Manatu, Ituaiga
Fa'aigoaina Entity Recognition (NER) e fesoasoani ia te oe e atia'e fa'ata'ita'iga masini ma fa'ata'ita'iga NLP. A'oa'o NER fa'aoga-mataupu, fa'ata'ita'iga, ma le tele o isi mea i lenei pou fa'amatalaga sili.
fofo o Faafitauli
Fa'amatalaga Fa'amatalaga Fa'afoma'i Fa'atonu a Tagata
80% o faʻamaumauga i totonu ole vaega ole soifua maloloina e le faʻatulagaina, e le mafai ai ona maua. O le mauaina o faʻamaumauga e manaʻomia ai le faʻaogaina o le tusi lesona, lea e faʻatapulaʻa ai le aofaʻi o faʻamatalaga faʻaaogaina.
tesi
Fa'amatalaga Fa'amatalaga i Masini A'oa'oga: Ose Ta'iala Atoa
Fa'amatalaga tusitusia ile a'oa'oga masini e fa'atatau ile fa'aopoopoina o metadata po'o fa'ailoga i fa'amatalaga tusitusia mata'utia e fausia ai fa'amaumauga fa'atulagaina mo a'oa'oga, iloiloga, ma fa'aleleia atili fa'ata'ita'iga a'oa'oga masini.
E te mana'o e fausia au lava fa'amaumauga a'oa'oga a le NER?
Fa'afeso'ota'i i matou nei e a'oa'o pe fa'afefea ona matou aoina se fa'amaumauga tu'ufa'atasi NER mo lau fofo tulaga ese AI/ML
Fesili e masani ona fesiligia (Fesili)
Fa'ailoga Fa'aigoa Fa'aigoaina ose vaega o le Fa'agaioiina o Gagana Faanatura. O le fa'amoemoe autu o le NER o le fa'agaioiina o fa'amaumauga fa'atulagaina ma le fa'atulagaina ma fa'avasegaina fa'aigoa fa'aigoaina i ni fa'avasegaga. O nisi o vaega masani e aofia ai le igoa, nofoaga, kamupani, taimi, tulaga tau tupe, mea na tutupu, ma isi mea.
I se faapuupuuga, NER e feagai ma:
Fa'aigoaina fa'aigoaina/su'eina - Fa'ailoaina o se upu po'o se fa'asologa o upu i totonu o se pepa.
Fa'avasegaga fa'aigoa - Fa'avasegaina fa'aletino uma ua iloa ile fa'avasegaga.
O le fa'agaioiina o le Gagana Faanatura e fesoasoani i le atina'eina o masini atamai e mafai ona maua mai ai le uiga mai le tautala ma tusitusiga. Masini A'oa'oga fesoasoani i nei faiga atamai e fa'aauau a'oa'oga e ala i a'oa'oga i le tele o seti fa'amaumauga o gagana fa'anatura. E masani lava, o le NLP e aofia ai vaega tetele e tolu:
Malamalama i le fausaga ma tulafono o le gagana - Syntax
Tuuina mai o le uiga o upu, tusitusiga, ma tautalaga ma faailoa a latou sootaga - Semantics
Faailoaina ma le iloaina o upu tautala ma suia i tusitusiga - Lauga
O nisi o fa'ata'ita'iga masani o le fa'avasegaina o fa'alapotopotoga ua mua'i fuafuaina:
Tagata: Michael Jackson, Oprah Winfrey, Barack Obama, Susan Sarandon
nofoaga: Kanata, Honolulu, Bangkok, Pasila, Cambridge
faalapotopotoga: Samsung, Disney, Iunivesite o Yale, Google
taimi: 15.35, 12 PM,
O auala eseese i le fausiaina o faiga NER o:
faiga fa'avae lomifefiloi
Faiga fa'avae tulafono
Faiga fa'avae a'oa'oga i masini
Lagolagoina tagata fa'atau
Manuia lelei a Tagata Faigaluega
Fa'avasegaga Fa'afaigofie
Fa'asilisiliina Su'e Su'e
Fautuaga sa'o i totonu