LLM-Supported Manufacturing Mapping Generation
2019/10/02 by Schmidt, Wilma Johanna, Grangel-González, Irlan, Paschke, Adrian +1 · 168 citations
Computer Science · Decision Sciences · #Advanced Graph Neural Networks #Semantic Web and Ontologies #Data Quality and Management
paper · pdf · doi:10.4230/tgdk.3.3.5
Abstract
5:1
Cited by
- Laplace Redux -- Effortless Bayesian Deep Learning
- Learning to Taste: A Multimodal Wine Dataset
- AutoFreeze: Automatically Freezing Model Blocks to Accelerate Fine-tuning
- The Lottery Ticket Hypothesis for Pre-trained BERT Networks
- Immersive exposure to simulated visual hallucinations modulates high-level human cognition
- Sub-Linear Memory: How to Make Performers SLiM
- Combat COVID-19 infodemic using explainable natural language processing models
- Improving Probabilistic Models In Text Classification Via Active Learning
- Contrastive Distillation on Intermediate Representations for Language Model Compression
- RefBERT: Compressing BERT by Referencing to Pre-computed Representations
- DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference
- Adversarial NLI for Factual Correctness in Text Summarisation Models
- HyperText: Endowing FastText with Hyperbolic Geometry
- MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
- Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey
- On the Opportunities and Risks of Foundation Models
- BERT Loses Patience: Fast and Robust Inference with Early Exit
- Learning to Teach with Student Feedback
- Transformer-Based Named Entity Recognition in Construction Supply Chain Risk Management in Australia
- A Simple Language Model for Task-Oriented Dialogue
- Magic Pyramid: Accelerating Inference with Early Exiting and Token Pruning
- On the Robustness of Intent Classification and Slot Labeling in\n Goal-oriented Dialog Systems to Real-world Noise
- Switch Point biased Self-Training: Re-purposing Pretrained Models for\n Code-Switching
- IIITT@LT-EDI-EACL2021-Hope Speech Detection: There is always Hope in Transformers
- Calibrating Structured Output Predictors for Natural Language Processing
- Learning Spatiotemporal Features via Video and Text Pair Discrimination
- PIMNet: A Parallel, Iterative and Mimicking Network for Scene Text Recognition
- EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation
- WhiteningBERT: An Easy Unsupervised Sentence Embedding Approach
- ProtoryNet - Interpretable Text Classification Via Prototype Trajectories
- True Few-Shot Learning with Language Models
- MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers
- Opinion Prediction with User Fingerprinting
- MKD: a Multi-Task Knowledge Distillation Approach for Pretrained Language Models
- Zero-Shot Open-Book Question Answering
- DC-BERT: Decoupling Question and Document for Efficient Contextual Encoding
- Optimal Subarchitecture Extraction For BERT
- How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding
- Distilling Linguistic Context for Language Model Compression
- Parameter-Efficient Transfer Learning with Diff Pruning
- What Can We Learn from Collective Human Opinions on Natural Language Inference Data?
- Students Need More Attention: BERT-based AttentionModel for Small Data with Application to AutomaticPatient Message Triage
- Graph-based Multilingual Product Retrieval in E-commerce Search
- On the effect of dropping layers of pre-trained transformer models
- Align before Fuse: Vision and Language Representation Learning with Momentum Distillation
- Inno at SemEval-2020 Task 11: Leveraging Pure Transformer for Multi-Class Propaganda Detection
- Gestalt: a Stacking Ensemble for SQuAD2.0
- AdaBERT: Task-Adaptive BERT Compression with Differentiable Neural Architecture Search
- Flower: A Friendly Federated Learning Research Framework
- Assessing Phrasal Representation and Composition in Transformers
- Which *BERT? A Survey Organizing Contextualized Encoders
- FairFil: Contrastive Neural Debiasing Method for Pretrained Text Encoders
- FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metricsfor Automatic Text Generation
- DynaBERT: Dynamic BERT with Adaptive Width and Depth
- Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Commonsense Reasoning
- Conv-Linformer: Boosting Linformer's Performance with Convolution in Small-Scale Settings
- Consistent Accelerated Inference via Confident Adaptive Transformers
- IDS at SemEval-2020 Task 10: Does Pre-trained Language Model Know What to Emphasize?
- Unsupervised Natural Language Inference via Decoupled Multimodal Contrastive Learning
- Causal Mediation Analysis for Interpreting Neural NLP: The Case of Gender Bias
- CL-NERIL: A Cross-Lingual Model for NER in Indian Languages
- SuperShaper: Task-Agnostic Super Pre-training of BERT Models with Variable Hidden Dimensions
- Recent Advances in Named Entity Recognition: A Comprehensive Survey and Comparative Study
- DynaEval: Unifying Turn and Dialogue Level Evaluation
- AdvPicker: Effectively Leveraging Unlabeled Data via Adversarial Discriminator for Cross-Lingual NER
- A Compression-Compilation Framework for On-mobile Real-time BERT Applications
- Virtual Steps: The Experience of Walking for a Lifelong Wheelchair User in Virtual Reality
- Remembering without (representational) memory: a neuro-computational study on regaining categoricity and compositionality from minimal traces
- SMYRF: Efficient Attention using Asymmetric Clustering
- Generating Plausible Counterfactual Explanations for Deep Transformers in Financial Text Classification
- Dual-View Distilled BERT for Sentence Embedding
- UBAR: Towards Fully End-to-End Task-Oriented Dialog Systems with GPT-2
- Pairwise Supervised Contrastive Learning of Sentence Representations
- The Brownian motion in the transformer model
- Metadata Shaping: Natural Language Annotations for the Tail
- InsertGNN: Can Graph Neural Networks Outperform Humans in TOEFL Sentence Insertion Problem?
- Environment Inference for Invariant Learning
- DeepZensols: Deep Natural Language Processing Framework
- MMIU: Dataset for Visual Intent Understanding in Multimodal Assistants
- Guiding the Growth: Difficulty-Controllable Question Generation through Step-by-Step Rewriting
- Accelerating Training of Transformer-Based Language Models with Progressive Layer Dropping
- Primer AI's Systems for Acronym Identification and Disambiguation
- Exploring Versatile Generative Language Model Via Parameter-Efficient Transfer Learning
- Progressively Stacking 2.0: A Multi-stage Layerwise Training Method for BERT Training Speedup
- Large Language Models, Agency, and Why Speech Acts are Beyond Them (For Now) – A Kantian-Cum-Pragmatist Case
- EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets
- ROSITA: Refined BERT cOmpreSsion with InTegrAted techniques
- Improved knowledge distillation by utilizing backward pass knowledge in\n neural networks
- Log-based Anomaly Detection Without Log Parsing
- Quality Estimation Using Round-trip Translation with Sentence Embeddings
- Communication-Efficient Federated Distillation
- Comparison of biomedical relationship extraction methods and models for knowledge graph creation
- Length-Adaptive Transformer: Train Once with Length Drop, Use Anytime with Search
- Movement Pruning: Adaptive Sparsity by Fine-Tuning
- Pre-trained language models as knowledge bases for Automotive Complaint Analysis
- HULK: An Energy Efficiency Benchmark Platform for Responsible Natural Language Processing
- BinaryBERT: Pushing the Limit of BERT Quantization
- LRC-BERT: Latent-representation Contrastive Knowledge Distillation for Natural Language Understanding
- The Cost of Training NLP Models: A Concise Overview
- Exploring the Promises of Transformer-Based LMs for the Representation of Normative Claims in the Legal Domain
- A Simple but Effective BERT Model for Dialog State Tracking on Resource-Limited Systems
- LightMBERT: A Simple Yet Effective Method for Multilingual BERT Distillation
- RomeBERT: Robust Training of Multi-Exit BERT
- Early Exiting with Ensemble Internal Classifiers
- Transfer Learning and Distant Supervision for Multilingual Transformer\n Models: A Study on African Languages
- ConvBERT: Improving BERT with Span-based Dynamic Convolution
- When BERT Plays the Lottery, All Tickets Are Winning
- Multi-Label Few-Shot Learning for Aspect Category Detection
- Using large language models to extract plant functional traits from unstructured text
- The Data Gradient: Quantifying Dataset Influence in End-to-End Machine Learning Systems
- Distilling Knowledge from Pre-trained Language Models via Text Smoothing
- Machine Reading Comprehension: The Role of Contextualized Language Models and Beyond
- NxMTransformer: Semi-Structured Sparsification for Natural Language Understanding via ADMM
- LV-BERT: Exploiting Layer Variety for BERT
- Offense Detection in Dravidian Languages using Code-Mixing Index based\n Focal Loss
- Rethinking Network Pruning -- under the Pre-train and Fine-tune Paradigm
- KDLSQ-BERT: A Quantized Bert Combining Knowledge Distillation with Learned Step Size Quantization
- Impact of AI assistance on student agency
- TRANS-BLSTM: Transformer with Bidirectional LSTM for Language Understanding
- Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation
- CPM: A Large-scale Generative Chinese Pre-trained Language Model
- Urban Crowdsensing using Social Media: An Empirical Study on Transformer and Recurrent Neural Networks
- Improving Task-Agnostic BERT Distillation with Layer Mapping Search
- Contextualized Perturbation for Textual Adversarial Attack
- Ensemble Distillation for Robust Model Fusion in Federated Learning
- Grounded Adaptation for Zero-shot Executable Semantic Parsing
- Fast, Structured Clinical Documentation via Contextual Autocomplete
- A Survey of Deep Learning for Scientific Discovery
- Aligning AI With Shared Human Values
- MeLT: Message-Level Transformer with Masked Document Representations as\n Pre-Training for Stance Detection
- Red Dragon AI at TextGraphs 2021 Shared Task: Multi-Hop Inference Explanation Regeneration by Matching Expert Ratings
- TAG: Gradient Attack on Transformer-based Language Models
- TernaryBERT: Distillation-aware Ultra-low Bit BERT
- One Teacher is Enough? Pre-trained Language Model Distillation from Multiple Teachers
- Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models
- NLP for Ghanaian Languages
- DKM: Differentiable K-Means Clustering Layer for Neural Network Compression
- Combat COVID-19 Infodemic Using Explainable Natural Language Processing Models
- Dynamic Knowledge Distillation for Pre-trained Language Models
- MicroNet for Efficient Language Modeling
- Partner Personas Generation for Diverse Dialogue Generation
- LogME: Practical Assessment of Pre-trained Models for Transfer Learning
- Language Models are Few-Shot Learners
- WILDS: A Benchmark of in-the-Wild Distribution Shifts
- MixKD: Towards Efficient Distillation of Large-scale Language Models
- SMURF: SeMantic and linguistic UndeRstanding Fusion for Caption Evaluation via Typicality Analysis
- Open-Domain Conversational Agents: Current Progress, Open Problems, and Future Directions
- ALFWorld: Aligning Text and Embodied Environments for Interactive Learning
- You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Nature Gradient
- Thinking Fast and Slow: Efficient Text-to-Visual Retrieval with\n Transformers
- CascadeBERT: Accelerating Inference of Pre-trained Language Models via Calibrated Complete Models Cascade
- LanguageRefer: Spatial-Language Model for 3D Visual Grounding
- Nyströmformer: A Nyström-Based Algorithm for Approximating Self-Attention
- Elbert: Fast Albert with Confidence-Window Based Early Exit
- Improved Goal Oriented Dialogue via Utterance Generation and Look Ahead
- Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed
- Ranking and Tuning Pre-trained Models: A New Paradigm for Exploiting Model Hubs
- BitTensor: A Peer-to-Peer Intelligence Market
- Influence Patterns for Explaining Information Flow in BERT
- Utility is in the Eye of the User: A Critique of NLP Leaderboards
- Emergent Properties of Finetuned Language Representation Models
- Structured Pruning of a BERT-based Question Answering Model
- A Benchmark for Lease Contract Review
- Adding Recurrence to Pretrained Transformers for Improved Efficiency and Context Size
- Changing the Mind of Transformers for Topically-Controllable Language Generation
- Re-Evaluating GermEval17 Using German Pre-Trained Language Models
- Compressed Deep Networks: Goodbye SVD, Hello Robust Low-Rank Approximation
- Contextual Text Embeddings for Twi
Related