Current network architecture Visual diagram Just a sketch. So-called safe LAN, in which there will be no unexpected public traffic inbound under normal circumstances. In local LAN, us...
SpringBoot Scala Spark Co-Develop Dependency Problem
Key Word java.lang.NoClassDefFoundError: org/codehaus/janino/InternalCompilerExceptionProblem Description Versions Overview Java - OpenJDK8 Spark - 2.4.7 Spring Boot - 2.4.1 (Dep...
Try Understanding Lombok
Try Understanding Lombok What is Lombok Project Lombok MVN Repo 大概一年多以前我接触Sping Boot的设计模式时, 了解到Entity, Service, Repository, 等层次设计的时候, POJO什么的. 当时的项目用的是Spring Data JPA做的持久层, 中间经过几层的数据, 对象...
Code Scoping in Data Practicing
Code Scoping in Data Practicing Personal Notes cast() in spark scala Found useful when I tried to import or operate on a dataFrame. Source code is as follows /** * Casts the column to ...
Test Drive Spark/Hadoop using Chicago Crime Data
Data Practicing-EP0 Before You Read This 该文只是一门课程数据挖掘的大作业记录文, 并不是教程式文章. Why This Topic? 看了很多人写的技术博客, 发现许多都是基于Pseudo-Distributed Mode或者Fully-Distributed Mode. 这两种模式因为资源问题我也只成功搭建并使用过前者, 当时在Window...
Weather Data Extraction
天气数据抓取 数据来自于National Weather Service Forecast Office 数据服务于Hadoop+Spark Data Practicing 需求 需要分析的主数据来自2001-2020年Chicago Area, 故对以下年份数据进行抓取 Data Copyright Notice:National Weather Servic...
SSH ProxyCommand NC ERROR
SSH ProxyCommand NC ERROR Description Platform: Manjaro 20 Configuration reference: using-proxy-for-git-or-github.md Error: Couldn't resolve host "x.x.x.x:8888" kex_exchange_identificatio...
Import SSH Key
Import SSH Key Key backup github.key for ssh login/authentication on github.com for generating key, visit Github Docs Re-import keys # Start key agent in background eval "$(ssh-agent -s)" ...
Import GPG Key
Import GPG Key After re-installing the system, I lost all my git setting since I did not back up the gitconfig file. I have a 2 gpg keys, one for Github and one for my personal Gitea Serv...
Titanic Data Analysis
Titanic Data Analysis Data Mining Course Assignment-3 # -*- coding: utf-8 -*- # @Author : 陈浩骏, 2017326603075 # Python Version == 3.8.5 import os import pandas as pd import numpy as np from ...