Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

抓取一个APP失败案例 #453

Open
fxp opened this issue Dec 25, 2018 · 10 comments
Open

抓取一个APP失败案例 #453

fxp opened this issue Dec 25, 2018 · 10 comments

Comments

@fxp
Copy link

fxp commented Dec 25, 2018

希望了解具体怎么调试这个问题。

Which platform are you running AnyProxy

Mac 10.14

The version of the AnyProxy

4.0.12

Your expected behavior of AnyProxy

运行 anyproxy -i --ws-intercept 启动的服务
EWA - English speaking course by LEARNING ENGLISH LAB PTE LTD
可以抓取到应用内的网络访问

The actual behavior of AnyProxy

应用停止在开机页面，抓取到的请求都是CONNECT的类型。
证书安装到了login和system里，也选了always trust
虽然每次启动都还是会报ROOT CA NOT INSTALLED YET。但其他应用，如Twitter，Google这样HTTPS的网页都可以打开抓取到body，应该证明证书安装成功了吧？

The log of the error

后台看到的是这样的
后台截图
会有一些类似api.appewa.com，graph.facebook.com的部分是灰色的。

$ anyproxy -i --ws-intercept
[AnyProxy WARN][2018-12-25 16:05:00]: ROOT CA NOT INSTALLED YET
? The rootCA is not trusted yet, install it to the trust store now? Yes
[AnyProxy Log][2018-12-25 16:05:06]: About to trust the root CA, this may requires your password
Password:
[AnyProxy Log][2018-12-25 16:05:09]: Root CA install, you are ready to intercept the https now
[AnyProxy Log][2018-12-25 16:05:09]: The root CA file path is: /Users/xxx/.anyproxy/certificates/rootCA.crt
[AnyProxy Log][2018-12-25 16:05:09]: Http proxy started on port 8001
[AnyProxy Log][2018-12-25 16:05:09]: web interface started on port 8002
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request graph.facebook.com
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request graph.facebook.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for graph.facebook.com established
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for graph.facebook.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request gate.hockeyapp.net
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for gate.hockeyapp.net established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request graph.facebook.com
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request www.gstatic.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for graph.facebook.com established
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for www.gstatic.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request play.googleapis.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for play.googleapis.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request p52-buy.itunes.apple.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for p52-buy.itunes.apple.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request api2.branch.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for api2.branch.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request api.appewa.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for api.appewa.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request api.appewa.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for api.appewa.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request api2.branch.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request device-provisioning.googleapis.com
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for api2.branch.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request api.appewa.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for device-provisioning.googleapis.com established
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request graph.facebook.com
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for api.appewa.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request graph.facebook.com
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request api2.branch.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for graph.facebook.com established
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for graph.facebook.com established
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for api2.branch.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request device-provisioning.googleapis.com
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request api.appewa.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for device-provisioning.googleapis.com established
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for api.appewa.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request api2.branch.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for api2.branch.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request events.appsflyer.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for events.appsflyer.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request events.appsflyer.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for events.appsflyer.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request itunes.apple.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for itunes.apple.com established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request itunes.apple.com
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for itunes.apple.com established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request api2.branch.io
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for api2.branch.io established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request t.appsflyer.com
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for t.appsflyer.com established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request api2.branch.io
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for api2.branch.io established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request events.appsflyer.com
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for events.appsflyer.com established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request api2.branch.io
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request events.appsflyer.com
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for api2.branch.io established
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for events.appsflyer.com established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request api2.branch.io
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request events.appsflyer.com
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for api2.branch.io established
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for events.appsflyer.com established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request events.appsflyer.com
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for events.appsflyer.com established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request cloudconfig.googleapis.com
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for cloudconfig.googleapis.com established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request api.appewa.com
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for api.appewa.com established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request ssl.google-analytics.com
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for ssl.google-analytics.com established
[AnyProxy Log][2018-12-25 16:05:29]: received https CONNECT request graph.facebook.com
[AnyProxy Log][2018-12-25 16:05:29]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:29]: [internal https]proxy server for graph.facebook.com established
[AnyProxy Log][2018-12-25 16:05:30]: received https CONNECT request app-measurement.com
[AnyProxy Log][2018-12-25 16:05:30]: received https CONNECT request gate.hockeyapp.net
[AnyProxy Log][2018-12-25 16:05:30]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:30]: [internal https]proxy server for app-measurement.com established
[AnyProxy Log][2018-12-25 16:05:30]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:30]: [internal https]proxy server for gate.hockeyapp.net established
@codingfishman
Copy link
Collaborator

@fxp 部分应用可能自己会创建独立的https链接，不走系统的请求，此时无法抓到请求包，如果已有其他app能抓到包，说明证书是安装成功了

@fxp
Copy link
Author

fxp commented Jan 2, 2019

@codingfishman 但是用Charles是可以抓到的，所以可能是自签名CA的问题？

@zrzs
Copy link

zrzs commented May 17, 2019

同样的问题怎么处理啊
1、部分https的请求可以抓到，部分不行 received https CONNECT request api.****.com，应用报了出现SSL错误，无法与服务器建立连接
2、fiddler抓出问题的域名请求是ok的

有没有老铁知道怎么处理呢？在线等

@fxp
Copy link
Author

fxp commented May 17, 2019 via email

@zrzs
Copy link

zrzs commented May 17, 2019

如何判断呢 @fxp

@fxp
Copy link
Author

fxp commented May 17, 2019 via email

@zrzs
Copy link

zrzs commented May 17, 2019

@fxp 什么叫不走系统的请求呢？
为什么fiddler都可以正确抓取到，只是fiddler不灵活支持二次开发

@fxp
Copy link
Author

fxp commented May 17, 2019

@fxp 什么叫不走系统的请求呢？
为什么fiddler都可以正确抓取到，只是fiddler不灵活支持二次开发

fiddler能抓到内容？

@wangyuqi7
Copy link

遇到了同样的问题，请问您这边的问题有解决方案了吗？

@artibix
Copy link

artibix commented Feb 13, 2024

同问，也是无法抓取应用数据

@spirillen spirillen mentioned this issue Jan 18, 2025
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@fxp @codingfishman @zrzs @wangyuqi7 @artibix