爱可可AI论文推介(10月17日) LG-机器学习CV-计算机视觉CL-计算与语

LG - 机器学习 CV - 计算机视觉 CL - 计算与语言
1、[CV]*NeRF++: Analyzing and Improving Neural Radiance Fields
K Zhang, G Riegler, N Snavely, V Koltun
[Cornell Tech & Intel Labs]
神经辐射场分析与改进(NeRF++) ，讨论了辐射场的潜在歧义，即形状-亮度歧义，分析了NeRF在避免这种歧义方面取得的成功；解决了将NeRF用于大规模、无边界3D场景360度捕获对象时涉及的参数化问题，在这个具有挑战性的场景中提高了视图合成的保真度。
Neural Radiance Fields (NeRF) achieve impressive view synthesis results for a variety of capture settings, including 360 capture of bounded scenes and forward-facing capture of bounded and unbounded scenes. NeRF fits multi-layer perceptrons (MLPs) representing view-invariant opacity and view-dependent color volumes to a set of training images, and samples novel views based on volume rendering techniques. In this technical report, we first remark on radiance fields and their potential ambiguities, namely the shape-radiance ambiguity, and analyze NeRF's success in avoiding such ambiguities. Second, we address a parametrization issue involved in applying NeRF to 360 captures of objects within large-scale, unbounded 3D scenes. Our method improves view synthesis fidelity in this challenging scenario. Code is available at this https URL.
文章插图
文章插图
文章插图
文章插图
文章插图
2、[CL]*Vokenization: Improving Language Understanding with Contextualized, Visual-Grounded Supervision
H Tan, M Bansal
[UNC Chapel Hill]
视觉监督语言模型vokenization ，通过上下文化映射语言词条到相关图像(称为“vokens”) ，将多模态对齐外推到仅包含语言的数据。在相对较小的图像描述数据集上训练“vokenizer” ，再用它生成大语言语料库的vokens 。在这些生成的vokens的监督下，在多语言任务上比单纯自监督语言模型有显著改进。
Humans learn language by listening, speaking, writing, reading, and also, via interaction with the multimodal real world. Existing language pre-training frameworks show the effectiveness of text-only self-supervision while we explore the idea of a visually-supervised language model in this paper. We find that the main reason hindering this exploration is the large divergence in magnitude and distributions between the visually-grounded language datasets and pure-language corpora. Therefore, we develop a technique named "vokenization" that extrapolates multimodal alignments to language-only data by contextually mapping language tokens to their related images (which we call "vokens"). The "vokenizer" is trained on relatively small image captioning datasets and we then apply it to generate vokens for large language corpora. Trained with these contextually generated vokens, our visually-supervised language models show consistent improvements over self-supervised alternatives on multiple pure-language tasks such as GLUE, SQuAD, and SWAG. Code and pre-trained models publicly available at this https URL

爱可可AI论文推介(10月17日)

推荐阅读

【北京晚报】全球累计确诊已超231万！，德国新增确诊2078例，累计143475例

上海|上海农商银行半年报发布：深耕普惠金融减费让利支持实体经济

曼琪思爱时尚|真不知道她是怎么穿进去的，好勒，露西·海尔的裤子也太紧了吧

恩比德|德帅执教76人？曝恩比德坚决反对，西蒙斯偷笑！双帝或因他分手

无论盛开不盛开都是花?盛开或者不盛开,花都是花

[输女的游戏世界]比驱散式神强悍，阴阳师：鬼王酒吞童子的解除效果克制硬控

飞机|第二个黑匣子数据存储单元外观较完好已送往专业实验室进行译码

华晶超|“不回关注函”的豫金刚石三季报亏掉4.8亿，两董事对季报无法保真

砂锅粥煮多久粥煮多久

生菜牛肉饼的做法

我想养只萨摩耶可是平时上课白天就没啥时间照顾它不过下课后都宅在家里请问我养不养好呢

人民日报客户端：累计1264例，阿联酋新增新冠肺炎确诊病例240例

黄芪葛根枸杞茶

每日经济新闻|堪称教科书式维权！银行卡被盗刷10万，她这么操作银行连利息都要赔

【】沪指结束五连涨，这一板块表现不错

阿列克谢·纳瓦尔尼|俄反对派领袖陷入昏迷，德国诊所化验结果显示神经系统中毒

35岁防汛干部接班途中坠河遇难@35岁防汛干部接班途中坠河遇难致敬，送别！

如何正确引导孩子攀比心理问题如何正确引导孩子攀比心理

紫微星|网友：叫“全员搞笑”得了，王迅也退出了？《极限挑战》全员换血

床上用品床头罩的制作有哪些步骤床头罩如何制作